Apr 22 09:16:39 devstack cinder-volume[72989]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 22 09:16:39 devstack cinder-volume[72989]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 09:16:39 devstack cinder-volume[72989]: we strongly recommend against using it for new projects. Apr 22 09:16:39 devstack cinder-volume[72989]: If you are already using Eventlet, we recommend migrating to a different Apr 22 09:16:39 devstack cinder-volume[72989]: framework. For more detail see Apr 22 09:16:39 devstack cinder-volume[72989]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 09:16:39 devstack cinder-volume[72989]: import eventlet # noqa Apr 22 09:16:40 devstack cinder-volume[72989]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 09:16:40 devstack cinder-volume[72989]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 09:16:40 devstack cinder-volume[72989]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 09:16:41 devstack cinder-volume[72989]: INFO dbcounter [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Registered counter for database cinder Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_db.sqlalchemy.engines [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG dbcounter [-] [72989] Writer thread running {{(pid=72989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 09:16:41 devstack cinder-volume[72989]: INFO cinder.rpc [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 22 09:16:41 devstack cinder-volume[72989]: INFO cinder.rpc [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_db.sqlalchemy.engines [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:16:41 devstack cinder-volume[72989]: INFO cinder.volume.manager [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Determined volume DB was empty at startup. Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG cinder.volume.manager [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72989) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Apr 22 09:16:41 devstack cinder-volume[72989]: INFO cinder.volume.manager [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 22 09:16:41 devstack cinder-volume[72989]: WARNING stevedore.named [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 09:16:41 devstack cinder-volume[72989]: WARNING castellan.key_manager [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 09:16:41 devstack cinder-volume[72989]: WARNING cinder.keymgr.conf_key_mgr [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG cinder.volume.drivers.lvm [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72989) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_concurrency.processutils [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_concurrency.processutils [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] CMD "cinder-rtstool verify" returned: 0 in 0.228s {{(pid=72989) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_db.sqlalchemy.engines [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:16:41 devstack cinder-volume[72989]: INFO cinder.rpc [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 22 09:16:41 devstack cinder-volume[72989]: INFO cinder.rpc [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 22 09:16:41 devstack cinder-volume[72989]: WARNING stevedore.named [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 09:16:41 devstack cinder-volume[72989]: WARNING castellan.key_manager [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 09:16:41 devstack cinder-volume[72989]: INFO cinder.volume.manager [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_db.sqlalchemy.engines [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72989) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:16:41 devstack cinder-volume[72989]: INFO oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Starting 1 workers Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Started child 73096 {{(pid=72989) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Full set of CONF: {{(pid=72989) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] ******************************************************************************** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Configuration options gathered from: {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] ================================================================================ {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 22 09:16:41 devstack cinder-volume[73096]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] allow_availability_zone_fallback = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] allow_compression_on_image_upload = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] allowed_direct_url_schemes = [] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] api_rate_limit = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] auth_strategy = keystone {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] az_cache_duration = 3600 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_availability_zone = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_host = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_name = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_stats_polling_interval = 60 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backup_api_class = cinder.backup.api.API {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backup_name_template = backup-%s {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backup_use_same_host = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backup_use_temp_snapshot = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] chap_password = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] chap_username = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cinder_internal_tenant_project_id = ecf3245bbd8e47b7932f01e68f19ea6d {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cinder_internal_tenant_user_id = d491f8c6a82b4643b2bd4b7e3aea34bf {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cloned_volume_same_az = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cluster = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] compression_format = gzip {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] compute_api_class = cinder.compute.nova.API {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] config_dir = [] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] config_source = [] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] control_exchange = openstack {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] debug = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] default_availability_zone = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] default_group_type = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] default_volume_type = lvmdriver-1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] disk_geometry = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] driver_client_cert = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] driver_client_cert_key = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] driver_data_namespace = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] driver_ssl_cert_path = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] driver_ssl_cert_verify = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] driver_use_ssl = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] enable_force_upload = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] enable_new_services = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] enable_unsupported_driver = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] enforce_multipath_for_image_xfer = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] filter_function = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance_api_insecure = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance_api_servers = ['http://192.168.122.212/image'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance_api_ssl_compression = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance_ca_certificates_file = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance_catalog_info = image:glance:publicURL {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance_certfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance_keyfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance_num_retries = 3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance_request_timeout = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] goodness_function = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] graceful_shutdown_timeout = 5 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] group_api_class = cinder.group.api.API {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] host = devstack {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] image_compress_on_upload = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] image_conversion_address_space_limit = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] image_conversion_cpu_limit = 60 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] image_conversion_disable = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] image_upload_use_cinder_backend = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] image_upload_use_internal_tenant = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] image_volume_cache_enabled = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] image_volume_cache_max_count = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] image_volume_cache_max_size_gb = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] init_host_max_objects_retrieval = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] instance_format = [instance: %(uuid)s] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] iscsi_target_flags = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] iscsi_write_cache = on {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] iser_helper = tgtadm {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[73096]: INFO cinder.volume.manager [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] iser_ip_address = 192.168.122.212 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] iser_port = 3260 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] log_color = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] log_config_append = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] log_dir = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] log_file = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] log_options = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] log_rotate_interval = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] log_rotate_interval_type = days {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] log_rotation_type = none {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] max_age = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] max_logfile_count = 30 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] max_logfile_size_mb = 200 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] max_over_subscription_ratio = 20.0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] message_reap_interval = 86400 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] message_ttl = 2592000 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] migration_create_volume_timeout_secs = 300 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] monkey_patch = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] monkey_patch_modules = [] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] my_ip = 192.168.122.212 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] no_snapshot_gb_quota = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] num_iser_scan_tries = 3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] num_shell_tries = 3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] num_volume_device_scan_tries = 3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] nvmeof_conn_info_version = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] nvmet_ns_id = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] nvmet_port_id = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] osapi_max_limit = 1000 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] osapi_volume_ext_list = [] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] osapi_volume_listen_port = 8776 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] osapi_volume_use_ssl = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] osapi_volume_workers = 2 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] per_volume_size_limit = -1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] periodic_fuzzy_delay = 60 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] periodic_interval = 60 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] public_endpoint = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] publish_errors = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] quota_backup_gigabytes = 1000 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] quota_backups = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] quota_gigabytes = 1000 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] quota_groups = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] quota_snapshots = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] quota_volumes = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] rate_limit_burst = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] rate_limit_except_level = CRITICAL {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] rate_limit_interval = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] reinit_driver_count = 3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] replication_device = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] report_discard_supported = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] report_interval = 120 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] reservation_clean_interval = 86400 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] reservation_expire = 86400 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] reserved_image_namespaces = [] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] reserved_percentage = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] rpc_response_timeout = 120 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] run_external_periodic_tasks = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] scst_target_driver = iscsi {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] scst_target_iqn_name = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] service_down_time = 720 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] shell_completion = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] snapshot_name_template = snapshot-%s {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] snapshot_same_host = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] split_loggers = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] state_path = /opt/stack/data/cinder {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] storage_availability_zone = nova {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] storage_protocol = iSCSI {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] syslog_log_facility = LOG_USER {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] target_helper = lioadm {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] target_ip_address = 192.168.122.212 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] target_port = 3260 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] target_protocol = iscsi {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] target_secondary_ip_addresses = [] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] trace_flags = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] transport_url = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] until_refresh = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] use_chap_auth = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] use_default_quota_class = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] use_journal = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] use_json = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] use_multipath_for_image_xfer = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] use_stderr = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] use_syslog = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] verify_glance_signatures = enabled {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_api_class = cinder.volume.api.API {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_backend_name = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_clear = zero {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_clear_ionice = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_clear_size = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_copy_bps_limit = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_dd_blocksize = 1M {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_name_template = volume-%s {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_service_inithost_offload = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volume_usage_audit_period = month {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:41 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] zoning_mode = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_concurrency.disable_process_locking = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.admin_password = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.admin_token = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.admin_user = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.auth_port = 35357 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.auth_protocol = https {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.auth_section = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.auth_type = password {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.auth_uri = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.auth_version = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.cache = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.certfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.identity_uri = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.include_service_catalog = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.insecure = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:41 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.interface = public {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.keyfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_password = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcache_username = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.region_name = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.service_type = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.212/identity {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.backend = dogpile.cache.null {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.backend_argument = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.backend_expiration_time = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.config_prefix = cache.oslo {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.debug_cache_backend = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.enable_retry_client = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.enable_socket_keepalive = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.enabled = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.enforce_fips_mode = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.expiration_time = 600 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.hashclient_retry_attempts = 2 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.memcache_dead_retry = 300 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.memcache_pool_maxsize = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.memcache_sasl_enabled = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.password = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.proxies = [] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.redis_db = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.redis_server = localhost:6379 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.retry_attempts = 2 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.retry_delay = 0.0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.socket_keepalive_count = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.socket_keepalive_idle = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.socket_keepalive_interval = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.socket_timeout = 1.0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.tls_allowed_ciphers = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.tls_cafile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.tls_certfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.tls_enabled = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.tls_keyfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cache.username = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] coordination.backend_url = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.asyncio_connection = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.asyncio_slave_connection = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.backend = sqlalchemy {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.connection = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.connection_debug = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.connection_parameters = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.connection_recycle_time = 3600 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.connection_trace = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.db_inc_retry_interval = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.db_max_retries = 20 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.db_max_retry_interval = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.db_retry_interval = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.max_overflow = 50 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.max_pool_size = 5 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.max_retries = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.mysql_wsrep_sync_wait = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.pool_timeout = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.retry_interval = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.slave_connection = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.sqlite_synchronous = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.synchronous_reader = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] database.use_db_reconnect = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler.connection_string = messaging:// {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler.enabled = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler.es_doc_type = notification {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler.es_scroll_size = 10000 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler.es_scroll_time = 2m {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler.filter_error_trace = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler.hmac_keys = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler.sentinel_service_name = mymaster {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler.socket_timeout = 0.1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler.trace_requests = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler.trace_sqlalchemy = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler_jaeger.process_tags = {} {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler_jaeger.service_name_prefix = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] profiler_otlp.service_name_prefix = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_policy.enforce_new_defaults = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: WARNING oslo_config.cfg [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_policy.enforce_scope = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_policy.policy_default_rule = default {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_policy.policy_file = policy.yaml {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] privsep_osbrick.group = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] privsep_osbrick.helper_command = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack sudo[73100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] privsep_osbrick.user = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack sudo[73100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cinder_sys_admin.group = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cinder_sys_admin.helper_command = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] cinder_sys_admin.user = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] service_user.auth_section = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] service_user.auth_type = password {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] service_user.cafile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] service_user.certfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] service_user.collect_timing = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] service_user.insecure = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] service_user.keyfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] service_user.send_service_user_token = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] service_user.split_loggers = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] service_user.timeout = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance.auth_section = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance.auth_type = password {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance.certfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance.collect_timing = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance.insecure = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance.keyfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance.region_name = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance.split_loggers = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] glance.timeout = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.backend_availability_zone = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.chap_password = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.chap_username = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.disk_geometry = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.driver_client_cert = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.driver_client_cert_key = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.driver_data_namespace = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.driver_use_ssl = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.extra_capabilities = {} {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.filter_function = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.goodness_function = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.iscsi_target_flags = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.iscsi_write_cache = on {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.iser_helper = tgtadm {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.iser_ip_address = 192.168.122.212 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.iser_port = 3260 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.lvm_share_target = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.lvm_type = auto {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.num_shell_tries = 3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.replication_device = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.report_discard_supported = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.reserved_percentage = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.target_helper = tgtadm {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.target_ip_address = 192.168.122.212 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.target_port = 3260 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.target_protocol = iscsi {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.trace_flags = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.unique_fqdn_network = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.use_chap_auth = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.volume_backend_name = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.volume_clear = zero {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.volume_clear_ionice = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.volume_clear_size = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_reports.file_event_handler = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_reports.log_dir = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.backend_host = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.chap_password = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.chap_username = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.disk_geometry = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.driver_client_cert = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.extra_capabilities = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.filter_function = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.goodness_function = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.iser_helper = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.iser_ip_address = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.iser_port = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.lvm_share_target = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.lvm_type = auto {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.num_shell_tries = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.replication_device = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.report_discard_supported = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.reserved_percentage = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.scst_target_driver = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.storage_protocol = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.target_helper = lioadm {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.target_ip_address = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.target_port = 3260 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.trace_flags = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.use_chap_auth = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.volume_clear = zero {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.volume_clear_size = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] lvmdriver-1.volumes_dir = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.ssl = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_notifications.driver = [] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_notifications.retry = -1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] key_manager.fixed_key = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.barbican_api_version = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.barbican_endpoint = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.barbican_endpoint_type = public {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.barbican_region_name = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.cafile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.certfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.collect_timing = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.insecure = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.keyfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.number_of_retries = 60 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.retry_delay = 1 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.send_service_user_token = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.split_loggers = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.timeout = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.verify_ssl = True {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican.verify_ssl_path = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican_service_user.auth_section = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican_service_user.auth_type = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican_service_user.cafile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican_service_user.certfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican_service_user.collect_timing = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican_service_user.insecure = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican_service_user.keyfile = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican_service_user.split_loggers = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] barbican_service_user.timeout = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vault.approle_role_id = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vault.approle_secret_id = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vault.kv_mountpoint = secret {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vault.kv_path = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vault.kv_version = 2 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vault.namespace = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vault.root_token_id = **** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vault.ssl_ca_crt_file = None {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vault.timeout = 60.0 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vault.use_ssl = False {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:16:41 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] ******************************************************************************** {{(pid=72989) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 22 09:16:42 devstack sudo[73100]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:42 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.597s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:42 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:42 devstack sudo[73104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 09:16:42 devstack sudo[73104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:42 devstack sudo[73104]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:42 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.510s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:42 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:16:42 devstack cinder-volume[73096]: INFO cinder.brick.local_dev.lvm [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 22 09:16:42 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:42 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:42 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:42 devstack sudo[73352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 09:16:42 devstack sudo[73352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:43 devstack sudo[73352]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:43 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.518s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:43 devstack cinder-volume[73096]: DEBUG cinder.brick.local_dev.lvm [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=73096) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 22 09:16:43 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:43 devstack sudo[73560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 09:16:43 devstack sudo[73560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:44 devstack sudo[73560]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:44 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.129s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:44 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:44 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:44 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:44 devstack sudo[73783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 09:16:44 devstack sudo[73783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:45 devstack sudo[73783]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:45 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.473s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:45 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:45 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:45 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:45 devstack sudo[73792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 22 09:16:45 devstack sudo[73792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:45 devstack sudo[73792]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:45 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.459s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:45 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:45 devstack sudo[73795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 09:16:45 devstack sudo[73795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:46 devstack sudo[73795]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:46 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:46 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:46 devstack sudo[73800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 09:16:46 devstack sudo[73800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:46 devstack sudo[73800]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:46 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.488s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:46 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:46 devstack sudo[73806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 09:16:46 devstack sudo[73806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:47 devstack sudo[73806]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:47 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:47 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:47 devstack sudo[73811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 09:16:47 devstack sudo[73811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:47 devstack sudo[73811]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:47 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:47 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:47 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:47 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:47 devstack sudo[73815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 09:16:47 devstack sudo[73815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:48 devstack sudo[73815]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:48 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.607s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:48 devstack cinder-volume[73096]: INFO cinder.volume.drivers.lvm [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 22 09:16:48 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:48 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:48 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:48 devstack sudo[73883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 09:16:48 devstack sudo[73883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:48 devstack sudo[73883]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:48 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.436s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:48 devstack cinder-volume[73096]: DEBUG cinder.volume.drivers.lvm [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Updating volume stats {{(pid=73096) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 09:16:48 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:48 devstack sudo[73941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 09:16:48 devstack sudo[73941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:49 devstack sudo[73941]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:49 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.516s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:49 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:49 devstack sudo[74079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 09:16:49 devstack sudo[74079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:49 devstack sudo[74079]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:49 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.447s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:49 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:49 devstack sudo[74082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 09:16:49 devstack sudo[74082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:49 devstack sudo[74082]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:49 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.459s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:49 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:50 devstack sudo[74085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 09:16:50 devstack sudo[74085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:50 devstack sudo[74085]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:50 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.453s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:50 devstack cinder-volume[73096]: INFO cinder.volume.driver [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Driver hasn't implemented _init_vendor_properties() Apr 22 09:16:50 devstack cinder-volume[73096]: DEBUG cinder.volume.driver [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=73096) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 22 09:16:50 devstack cinder-volume[73096]: DEBUG oslo_db.sqlalchemy.engines [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=73096) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:16:50 devstack cinder-volume[73096]: DEBUG dbcounter [-] [73096] Writer thread running {{(pid=73096) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 09:16:50 devstack cinder-volume[73096]: DEBUG cinder.db.sqlalchemy.api [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Building query based on filter {{(pid=73096) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 22 09:16:50 devstack cinder-volume[73096]: DEBUG cinder.image.image_utils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=73096) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1304}} Apr 22 09:16:50 devstack cinder-volume[73096]: INFO cinder.keymgr.migration [None req-0f65c22f-4787-4737-aca2-17347c9db1e4 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 22 09:16:50 devstack cinder-volume[73096]: DEBUG cinder.volume.drivers.lvm [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Updating volume stats {{(pid=73096) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 09:16:50 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:50 devstack sudo[74093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 09:16:50 devstack sudo[74093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:51 devstack sudo[74093]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:51 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.500s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:51 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:51 devstack sudo[74099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 09:16:51 devstack sudo[74099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:51 devstack sudo[74099]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:51 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:51 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:51 devstack sudo[74105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 09:16:51 devstack sudo[74105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:51 devstack cinder-volume[72989]: DEBUG dbcounter [-] [72989] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72989) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:16:51 devstack sudo[74105]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:51 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.467s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:51 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:51 devstack sudo[74109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 09:16:51 devstack sudo[74109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:52 devstack sudo[74109]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:52 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:52 devstack cinder-volume[73096]: DEBUG cinder.manager [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Notifying Schedulers of capabilities ... {{(pid=73096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:16:52 devstack cinder-volume[73096]: INFO cinder.volume.manager [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Driver initialization completed successfully. Apr 22 09:16:52 devstack cinder-volume[73096]: INFO cinder.manager [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Initiating service 2 cleanup Apr 22 09:16:52 devstack cinder-volume[73096]: INFO cinder.manager [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Service 2 cleanup completed. Apr 22 09:16:52 devstack cinder-volume[73096]: DEBUG cinder.service [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Creating RPC server for service cinder-volume {{(pid=73096) start /opt/stack/cinder/cinder/service.py:231}} Apr 22 09:16:52 devstack cinder-volume[73096]: DEBUG cinder.service [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=73096) start /opt/stack/cinder/cinder/service.py:237}} Apr 22 09:16:52 devstack cinder-volume[73096]: INFO cinder.volume.manager [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 22 09:16:52 devstack cinder-volume[73096]: DEBUG cinder.volume.drivers.lvm [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Updating volume stats {{(pid=73096) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 09:16:52 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:52 devstack sudo[74117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 09:16:52 devstack sudo[74117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:52 devstack sudo[74117]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:53 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.495s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:53 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:53 devstack sudo[74135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 09:16:53 devstack sudo[74135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:53 devstack sudo[74135]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:53 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:53 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:53 devstack sudo[74177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 09:16:53 devstack sudo[74177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:53 devstack sudo[74177]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:53 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.432s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:53 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:16:53 devstack sudo[74180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 09:16:53 devstack sudo[74180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:16:54 devstack sudo[74180]: pam_unix(sudo:session): session closed for user root Apr 22 09:16:54 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.420s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:16:54 devstack cinder-volume[73096]: INFO cinder.volume.manager [None req-2432bf7f-b368-4bf9-907a-94000ee42380 None None] Driver post RPC initialization completed successfully. Apr 22 09:17:04 devstack cinder-volume[73096]: DEBUG dbcounter [-] [73096] Writing DB stats cinder:SELECT=4 {{(pid=73096) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:17:04 devstack cinder-volume[73096]: DEBUG dbcounter [-] [73096] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=73096) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:18:13 devstack cinder-volume[73096]: DEBUG oslo_service.periodic_task [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73096) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:18:13 devstack cinder-volume[73096]: DEBUG cinder.volume.drivers.lvm [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Updating volume stats {{(pid=73096) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 09:18:13 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:18:13 devstack sudo[79035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 09:18:13 devstack sudo[79035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:18:13 devstack sudo[79035]: pam_unix(sudo:session): session closed for user root Apr 22 09:18:13 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.443s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:18:13 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:18:13 devstack sudo[79040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 09:18:13 devstack sudo[79040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:18:14 devstack sudo[79040]: pam_unix(sudo:session): session closed for user root Apr 22 09:18:14 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:18:14 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:18:14 devstack sudo[79045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 09:18:14 devstack sudo[79045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:18:14 devstack sudo[79045]: pam_unix(sudo:session): session closed for user root Apr 22 09:18:14 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:18:14 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:18:14 devstack sudo[79049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 09:18:14 devstack sudo[79049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:18:15 devstack sudo[79049]: pam_unix(sudo:session): session closed for user root Apr 22 09:18:15 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.437s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:18:15 devstack cinder-volume[73096]: DEBUG cinder.manager [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Notifying Schedulers of capabilities ... {{(pid=73096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:19:04 devstack cinder-volume[73096]: DEBUG dbcounter [-] [73096] Writing DB stats cinder:SELECT=1 {{(pid=73096) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:19:04 devstack cinder-volume[73096]: DEBUG dbcounter [-] [73096] Writing DB stats cinder:UPDATE=1 {{(pid=73096) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:19:13 devstack cinder-volume[73096]: DEBUG oslo_service.periodic_task [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=73096) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:19:13 devstack cinder-volume[73096]: DEBUG cinder.volume.drivers.lvm [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Updating volume stats {{(pid=73096) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 22 09:19:13 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:19:13 devstack sudo[80942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 22 09:19:13 devstack sudo[80942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:19:13 devstack sudo[80942]: pam_unix(sudo:session): session closed for user root Apr 22 09:19:13 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.424s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:19:13 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:19:13 devstack sudo[80948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 09:19:13 devstack sudo[80948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:19:14 devstack sudo[80948]: pam_unix(sudo:session): session closed for user root Apr 22 09:19:14 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.419s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:19:14 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:19:14 devstack sudo[80952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 22 09:19:14 devstack sudo[80952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:19:14 devstack sudo[80952]: pam_unix(sudo:session): session closed for user root Apr 22 09:19:14 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.417s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:19:14 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:19:14 devstack sudo[80955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 22 09:19:14 devstack sudo[80955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:19:14 devstack sudo[80955]: pam_unix(sudo:session): session closed for user root Apr 22 09:19:14 devstack cinder-volume[73096]: DEBUG oslo_concurrency.processutils [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.416s {{(pid=73096) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:19:14 devstack cinder-volume[73096]: DEBUG cinder.manager [None req-796cec76-08ae-4530-8725-c19952f3c40f None None] Notifying Schedulers of capabilities ... {{(pid=73096) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:20:07 devstack cinder-volume[72989]: INFO oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Caught SIGTERM, stopping children Apr 22 09:20:07 devstack cinder-volume[72989]: DEBUG oslo_concurrency.lockutils [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Acquiring lock "singleton_lock" {{(pid=72989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 09:20:07 devstack cinder-volume[72989]: DEBUG oslo_concurrency.lockutils [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Acquired lock "singleton_lock" {{(pid=72989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 09:20:07 devstack cinder-volume[72989]: DEBUG oslo_concurrency.lockutils [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Releasing lock "singleton_lock" {{(pid=72989) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 09:20:07 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Stop services. {{(pid=72989) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 22 09:20:07 devstack cinder-volume[72989]: DEBUG oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Killing children. {{(pid=72989) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 22 09:20:07 devstack cinder-volume[72989]: INFO oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Waiting on 1 children to exit Apr 22 09:20:07 devstack cinder-volume[73096]: DEBUG oslo_concurrency.lockutils [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Acquiring lock "singleton_lock" {{(pid=73096) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 09:20:07 devstack cinder-volume[73096]: DEBUG oslo_concurrency.lockutils [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Acquired lock "singleton_lock" {{(pid=73096) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 09:20:07 devstack cinder-volume[73096]: DEBUG oslo_concurrency.lockutils [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Releasing lock "singleton_lock" {{(pid=73096) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 09:20:07 devstack cinder-volume[73096]: WARNING amqp [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 22 09:20:07 devstack cinder-volume[73096]: WARNING amqp [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 22 09:20:07 devstack cinder-volume[72989]: INFO oslo_service.backend._eventlet.service [None req-b32400df-3128-4cf4-b2f5-ed6eba631a02 None None] Child 73096 exited with status 0 Apr 22 09:20:07 devstack cinder-volume[82139]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 22 09:20:07 devstack cinder-volume[82139]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 09:20:07 devstack cinder-volume[82139]: we strongly recommend against using it for new projects. Apr 22 09:20:07 devstack cinder-volume[82139]: If you are already using Eventlet, we recommend migrating to a different Apr 22 09:20:07 devstack cinder-volume[82139]: framework. For more detail see Apr 22 09:20:07 devstack cinder-volume[82139]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 09:20:07 devstack cinder-volume[82139]: import eventlet # noqa Apr 22 09:20:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 09:20:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 09:20:09 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 09:20:10 devstack cinder-volume[82139]: INFO dbcounter [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Registered counter for database cinder Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_db.sqlalchemy.engines [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG dbcounter [-] [82139] Writer thread running {{(pid=82139) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 09:20:10 devstack cinder-volume[82139]: INFO cinder.rpc [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 22 09:20:10 devstack cinder-volume[82139]: INFO cinder.rpc [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_db.sqlalchemy.engines [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:20:10 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Determined volume DB was empty at startup. Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG cinder.volume.manager [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82139) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Apr 22 09:20:10 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 22 09:20:10 devstack cinder-volume[82139]: WARNING stevedore.named [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 09:20:10 devstack cinder-volume[82139]: WARNING castellan.key_manager [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 09:20:10 devstack cinder-volume[82139]: WARNING cinder.keymgr.conf_key_mgr [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 09:20:10 devstack cinder-volume[82139]: INFO cinder.volume.manager [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_db.sqlalchemy.engines [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82139) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:20:10 devstack cinder-volume[82139]: INFO oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Starting 1 workers Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Started child 82253 {{(pid=82139) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Full set of CONF: {{(pid=82139) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] ******************************************************************************** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Configuration options gathered from: {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] ================================================================================ {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] allow_availability_zone_fallback = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] allow_compression_on_image_upload = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] allowed_direct_url_schemes = [] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] api_rate_limit = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] auth_strategy = keystone {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_availability_zone = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_host = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_name = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_stats_polling_interval = 60 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backup_api_class = cinder.backup.api.API {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backup_name_template = backup-%s {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backup_use_same_host = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backup_use_temp_snapshot = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] chap_password = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] chap_username = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cinder_internal_tenant_project_id = ecf3245bbd8e47b7932f01e68f19ea6d {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cinder_internal_tenant_user_id = d491f8c6a82b4643b2bd4b7e3aea34bf {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cluster = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] compression_format = gzip {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] compute_api_class = cinder.compute.nova.API {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] config_dir = [] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] config_source = [] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] control_exchange = openstack {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] debug = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] default_availability_zone = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] default_group_type = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] default_volume_type = QuobyteHD {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] disk_geometry = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] driver_client_cert = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] driver_client_cert_key = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] driver_data_namespace = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] driver_ssl_cert_path = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] driver_ssl_cert_verify = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] driver_use_ssl = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] enable_new_services = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] enable_unsupported_driver = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] enabled_backends = ['QuobyteHD'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] enforce_multipath_for_image_xfer = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] filter_function = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance_api_insecure = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance_api_servers = ['http://192.168.122.212/image'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance_api_ssl_compression = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance_ca_certificates_file = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance_catalog_info = image:glance:publicURL {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance_certfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82253]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance_keyfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance_num_retries = 3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance_request_timeout = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] goodness_function = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] graceful_shutdown_timeout = 5 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] group_api_class = cinder.group.api.API {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] host = devstack {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] image_compress_on_upload = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] image_conversion_address_space_limit = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] image_conversion_cpu_limit = 60 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] image_conversion_disable = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] image_upload_use_cinder_backend = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] image_upload_use_internal_tenant = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] image_volume_cache_enabled = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] image_volume_cache_max_count = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] image_volume_cache_max_size_gb = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] init_host_max_objects_retrieval = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] instance_format = [instance: %(uuid)s] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] iscsi_target_flags = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] iscsi_write_cache = on {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] iser_helper = tgtadm {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] iser_ip_address = 192.168.122.212 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] iser_port = 3260 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] log_color = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] log_config_append = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] log_dir = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] log_file = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] log_options = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] log_rotate_interval = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] log_rotate_interval_type = days {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] log_rotation_type = none {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] max_age = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] max_logfile_count = 30 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] max_logfile_size_mb = 200 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] max_over_subscription_ratio = 20.0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] message_reap_interval = 86400 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] message_ttl = 2592000 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] migration_create_volume_timeout_secs = 300 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] monkey_patch = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] monkey_patch_modules = [] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] my_ip = 192.168.122.212 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] no_snapshot_gb_quota = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] num_iser_scan_tries = 3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] num_shell_tries = 3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] num_volume_device_scan_tries = 3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] nvmeof_conn_info_version = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] nvmet_ns_id = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] nvmet_port_id = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] osapi_max_limit = 1000 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] osapi_volume_ext_list = [] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] osapi_volume_listen_port = 8776 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] osapi_volume_use_ssl = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] osapi_volume_workers = 2 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] per_volume_size_limit = -1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] periodic_fuzzy_delay = 60 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] periodic_interval = 60 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] public_endpoint = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] publish_errors = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] quota_backup_gigabytes = 1000 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] quota_backups = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] quota_gigabytes = 1000 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] quota_groups = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] quota_snapshots = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] quota_volumes = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] rate_limit_burst = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] rate_limit_except_level = CRITICAL {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] rate_limit_interval = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] reinit_driver_count = 3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] replication_device = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] report_discard_supported = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] report_interval = 120 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] reservation_clean_interval = 86400 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] reservation_expire = 86400 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] reserved_image_namespaces = [] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] reserved_percentage = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] rpc_response_timeout = 120 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] run_external_periodic_tasks = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] scst_target_driver = iscsi {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] scst_target_iqn_name = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] service_down_time = 720 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] shell_completion = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] snapshot_name_template = snapshot-%s {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] split_loggers = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] state_path = /opt/stack/data/cinder {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] storage_availability_zone = nova {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] storage_protocol = iSCSI {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] syslog_log_facility = LOG_USER {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] target_helper = lioadm {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] target_ip_address = 192.168.122.212 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] target_port = 3260 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] target_protocol = iscsi {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] target_secondary_ip_addresses = [] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] trace_flags = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] transport_url = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] until_refresh = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] use_chap_auth = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] use_default_quota_class = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] use_journal = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] use_json = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] use_multipath_for_image_xfer = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] use_stderr = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] use_syslog = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] verify_glance_signatures = enabled {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_api_class = cinder.volume.api.API {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_backend_name = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_clear = zero {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_clear_ionice = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_clear_size = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_copy_bps_limit = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_dd_blocksize = 1M {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_name_template = volume-%s {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_service_inithost_offload = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volume_usage_audit_period = month {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] zoning_mode = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_concurrency.disable_process_locking = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.admin_password = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.admin_token = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.admin_user = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.auth_port = 35357 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.auth_protocol = https {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.auth_section = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.auth_type = password {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.auth_uri = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.auth_version = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.cache = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.certfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.identity_uri = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.include_service_catalog = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.insecure = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.interface = public {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.keyfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_password = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcache_username = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.region_name = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.service_type = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.212/identity {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.backend = dogpile.cache.null {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.backend_argument = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.backend_expiration_time = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.config_prefix = cache.oslo {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.debug_cache_backend = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.enable_retry_client = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.enable_socket_keepalive = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.enabled = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.enforce_fips_mode = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.expiration_time = 600 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.hashclient_retry_attempts = 2 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.memcache_dead_retry = 300 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.memcache_pool_maxsize = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.memcache_sasl_enabled = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.password = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.proxies = [] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.redis_db = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.redis_server = localhost:6379 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.retry_attempts = 2 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.retry_delay = 0.0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.socket_keepalive_count = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.socket_keepalive_idle = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.socket_keepalive_interval = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.socket_timeout = 1.0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.tls_allowed_ciphers = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.tls_cafile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.tls_certfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.tls_enabled = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.tls_keyfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cache.username = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] coordination.backend_url = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.asyncio_connection = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.asyncio_slave_connection = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.backend = sqlalchemy {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.connection = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.connection_debug = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.connection_parameters = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.connection_recycle_time = 3600 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.connection_trace = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.db_inc_retry_interval = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.db_max_retries = 20 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.db_max_retry_interval = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.db_retry_interval = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.max_overflow = 50 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.max_pool_size = 5 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.max_retries = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.mysql_wsrep_sync_wait = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.pool_timeout = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.retry_interval = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.slave_connection = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.sqlite_synchronous = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.synchronous_reader = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] database.use_db_reconnect = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler.connection_string = messaging:// {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler.enabled = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler.es_doc_type = notification {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler.es_scroll_size = 10000 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler.es_scroll_time = 2m {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler.filter_error_trace = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler.hmac_keys = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler.sentinel_service_name = mymaster {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler.socket_timeout = 0.1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler.trace_requests = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler.trace_sqlalchemy = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82253]: INFO cinder.volume.manager [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler_jaeger.process_tags = {} {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler_jaeger.service_name_prefix = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] profiler_otlp.service_name_prefix = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82253]: DEBUG cinder.volume.drivers.remotefs [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82253) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:227}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_policy.enforce_new_defaults = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: WARNING oslo_config.cfg [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_policy.enforce_scope = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_policy.policy_default_rule = default {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_policy.policy_file = policy.yaml {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] privsep_osbrick.group = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] privsep_osbrick.helper_command = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] privsep_osbrick.user = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cinder_sys_admin.group = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cinder_sys_admin.helper_command = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] cinder_sys_admin.user = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] service_user.auth_section = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] service_user.auth_type = password {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] service_user.cafile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] service_user.certfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] service_user.collect_timing = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] service_user.insecure = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] service_user.keyfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] service_user.send_service_user_token = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] service_user.split_loggers = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] service_user.timeout = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance.auth_section = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance.auth_type = password {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance.certfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance.collect_timing = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance.insecure = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance.keyfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance.region_name = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance.split_loggers = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] glance.timeout = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.backend_availability_zone = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.chap_password = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.chap_username = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.disk_geometry = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.driver_client_cert = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.driver_client_cert_key = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.driver_data_namespace = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.driver_use_ssl = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.extra_capabilities = {} {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.filter_function = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.goodness_function = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.iscsi_target_flags = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.iscsi_write_cache = on {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.iser_helper = tgtadm {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.iser_ip_address = 192.168.122.212 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.iser_port = 3260 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nas_host = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nas_login = admin {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nas_mount_options = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nas_password = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nas_private_key = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nas_share_path = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.num_shell_tries = 3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.quobyte_volume_url = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.replication_device = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.report_discard_supported = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.reserved_percentage = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.target_helper = tgtadm {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.target_ip_address = 192.168.122.212 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.target_port = 3260 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.target_protocol = iscsi {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.trace_flags = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.unique_fqdn_network = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.use_chap_auth = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.volume_backend_name = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.volume_clear = zero {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.volume_clear_ionice = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.volume_clear_size = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_reports.file_event_handler = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_reports.log_dir = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.backend_availability_zone = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.backend_host = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.chap_password = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.chap_username = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.chiscsi_conf = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.disk_geometry = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.driver_client_cert = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.driver_data_namespace = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.driver_use_ssl = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.extra_capabilities = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.filter_function = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.goodness_function = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.iser_helper = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.iser_ip_address = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.iser_port = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.iser_target_prefix = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nas_host = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nas_login = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nas_mount_options = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nas_password = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nas_private_key = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nas_share_path = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nas_ssh_port = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.num_shell_tries = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.nvmet_port_id = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.replication_device = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.report_discard_supported = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.reserved_percentage = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.scst_target_driver = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.storage_protocol = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.target_helper = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.target_ip_address = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.target_port = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.target_prefix = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.target_protocol = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.trace_flags = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.use_chap_auth = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.volume_clear = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.volume_clear_size = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] QuobyteHD.volumes_dir = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.ssl = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_notifications.driver = [] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_notifications.retry = -1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] key_manager.fixed_key = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.barbican_api_version = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.barbican_endpoint = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.barbican_endpoint_type = public {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.barbican_region_name = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.cafile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.certfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.collect_timing = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.insecure = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.keyfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.number_of_retries = 60 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.retry_delay = 1 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.send_service_user_token = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.split_loggers = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.timeout = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.verify_ssl = True {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican.verify_ssl_path = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican_service_user.auth_section = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican_service_user.auth_type = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican_service_user.cafile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican_service_user.certfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican_service_user.collect_timing = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican_service_user.insecure = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican_service_user.keyfile = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican_service_user.split_loggers = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] barbican_service_user.timeout = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vault.approle_role_id = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vault.approle_secret_id = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vault.kv_mountpoint = secret {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vault.kv_path = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vault.kv_version = 2 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vault.namespace = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vault.root_token_id = **** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vault.ssl_ca_crt_file = None {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vault.timeout = 60.0 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vault.use_ssl = False {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:10 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] ******************************************************************************** {{(pid=82139) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 22 09:20:10 devstack cinder-volume[82253]: DEBUG cinder.volume.drivers.quobyte [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82253) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 22 09:20:10 devstack cinder-volume[82253]: WARNING cinder.volume.drivers.quobyte [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 22 09:20:10 devstack cinder-volume[82253]: WARNING cinder.volume.drivers.quobyte [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 22 09:20:10 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Running cmd (subprocess): mount.quobyte {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:20:10 devstack quobyte-client[82259]: Reading configuration file: /etc/quobyte/client.cfg Apr 22 09:20:10 devstack quobyte-client[82259]: Invalid parameters found, error: missing mount point. Apr 22 09:20:10 devstack quobyte-client[82259]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 22 09:20:10 devstack quobyte-client[82259]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 22 09:20:10 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] CMD "mount.quobyte" returned: 1 in 0.067s {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:20:10 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:20:10 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:20:10 devstack cinder-volume[82253]: DEBUG cinder.volume.drivers.quobyte [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82253) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:20:10 devstack cinder-volume[82253]: INFO cinder.volume.drivers.quobyte [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 ... Apr 22 09:20:10 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 -c /etc/quobyte/client-cinder.cfg {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:20:10 devstack sudo[82260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 -c /etc/quobyte/client-cinder.cfg Apr 22 09:20:10 devstack sudo[82260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:20:11 devstack sudo[82260]: pam_unix(sudo:session): session closed for user root Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.516s {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:20:11 devstack cinder-volume[82253]: INFO cinder.volume.drivers.quobyte [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 succeeded Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG cinder.volume.drivers.quobyte [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82253) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.523s {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:20:11 devstack sudo[82330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:20:11 devstack sudo[82330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:20:11 devstack sudo[82330]: pam_unix(sudo:session): session closed for user root Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.403s {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:20:11 devstack cinder-volume[82253]: INFO cinder.volume.driver [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Driver hasn't implemented _init_vendor_properties() Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG cinder.volume.driver [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82253) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG oslo_db.sqlalchemy.engines [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82253) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG dbcounter [-] [82253] Writer thread running {{(pid=82253) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG cinder.db.sqlalchemy.api [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Building query based on filter {{(pid=82253) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG cinder.image.image_utils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82253) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1304}} Apr 22 09:20:11 devstack cinder-volume[82253]: INFO cinder.keymgr.migration [None req-f7b39515-07fd-44b7-b16b-a08165050ac3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG cinder.volume.drivers.quobyte [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82253) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG cinder.volume.drivers.quobyte [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82253) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:20:11 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:20:11 devstack sudo[82333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:20:11 devstack sudo[82333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:20:12 devstack sudo[82333]: pam_unix(sudo:session): session closed for user root Apr 22 09:20:12 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.398s {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:20:12 devstack cinder-volume[82253]: DEBUG cinder.manager [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Notifying Schedulers of capabilities ... {{(pid=82253) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:20:12 devstack cinder-volume[82253]: INFO cinder.volume.manager [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Driver initialization completed successfully. Apr 22 09:20:12 devstack cinder-volume[82253]: INFO cinder.manager [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Initiating service 3 cleanup Apr 22 09:20:12 devstack cinder-volume[82253]: INFO cinder.manager [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Service 3 cleanup completed. Apr 22 09:20:12 devstack cinder-volume[82253]: DEBUG cinder.service [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Creating RPC server for service cinder-volume {{(pid=82253) start /opt/stack/cinder/cinder/service.py:231}} Apr 22 09:20:12 devstack cinder-volume[82253]: DEBUG cinder.service [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82253) start /opt/stack/cinder/cinder/service.py:237}} Apr 22 09:20:12 devstack cinder-volume[82253]: INFO cinder.volume.manager [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 22 09:20:12 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:20:12 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:20:12 devstack cinder-volume[82253]: DEBUG cinder.volume.drivers.quobyte [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82253) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:20:12 devstack cinder-volume[82253]: DEBUG cinder.volume.drivers.quobyte [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82253) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:20:12 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:20:12 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:20:12 devstack sudo[82338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:20:12 devstack sudo[82338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:20:12 devstack sudo[82338]: pam_unix(sudo:session): session closed for user root Apr 22 09:20:12 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.424s {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:20:12 devstack cinder-volume[82253]: INFO cinder.volume.manager [None req-cb1fa57b-4283-4853-a370-c7b47816eb49 None None] Driver post RPC initialization completed successfully. Apr 22 09:20:15 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-150bdcc1-2fa7-4f38-87b8-ee30236ec96c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:20:15 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-150bdcc1-2fa7-4f38-87b8-ee30236ec96c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:20:15 devstack cinder-volume[82253]: DEBUG cinder.volume.drivers.quobyte [None req-150bdcc1-2fa7-4f38-87b8-ee30236ec96c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82253) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:20:15 devstack cinder-volume[82253]: DEBUG cinder.volume.drivers.quobyte [None req-150bdcc1-2fa7-4f38-87b8-ee30236ec96c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82253) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:20:15 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-150bdcc1-2fa7-4f38-87b8-ee30236ec96c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82253) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:20:15 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-150bdcc1-2fa7-4f38-87b8-ee30236ec96c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:20:15 devstack sudo[82403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:20:15 devstack sudo[82403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:20:15 devstack sudo[82403]: pam_unix(sudo:session): session closed for user root Apr 22 09:20:15 devstack cinder-volume[82253]: DEBUG oslo_concurrency.processutils [None req-150bdcc1-2fa7-4f38-87b8-ee30236ec96c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.386s {{(pid=82253) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:20:15 devstack cinder-volume[82253]: DEBUG cinder.manager [None req-150bdcc1-2fa7-4f38-87b8-ee30236ec96c None None] Notifying Schedulers of capabilities ... {{(pid=82253) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:20:19 devstack cinder-volume[82139]: INFO oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Caught SIGTERM, stopping children Apr 22 09:20:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Acquiring lock "singleton_lock" {{(pid=82139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 09:20:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Acquired lock "singleton_lock" {{(pid=82139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 09:20:19 devstack cinder-volume[82139]: DEBUG oslo_concurrency.lockutils [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Releasing lock "singleton_lock" {{(pid=82139) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 09:20:19 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Stop services. {{(pid=82139) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 22 09:20:19 devstack cinder-volume[82139]: DEBUG oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Killing children. {{(pid=82139) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 22 09:20:19 devstack cinder-volume[82139]: INFO oslo_service.backend._eventlet.service [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Waiting on 1 children to exit Apr 22 09:20:22 devstack cinder-volume[82253]: DEBUG dbcounter [-] [82253] Writing DB stats cinder:SELECT=4 {{(pid=82253) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:20:22 devstack cinder-volume[82253]: DEBUG dbcounter [-] [82253] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=82253) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:20:24 devstack cinder-volume[82253]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Apr 22 09:20:24 devstack cinder-volume[82506]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 22 09:20:24 devstack cinder-volume[82506]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 09:20:24 devstack cinder-volume[82506]: we strongly recommend against using it for new projects. Apr 22 09:20:24 devstack cinder-volume[82506]: If you are already using Eventlet, we recommend migrating to a different Apr 22 09:20:24 devstack cinder-volume[82506]: framework. For more detail see Apr 22 09:20:24 devstack cinder-volume[82506]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 09:20:24 devstack cinder-volume[82506]: import eventlet # noqa Apr 22 09:20:25 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Acquiring lock "singleton_lock" {{(pid=82253) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 09:20:25 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Acquired lock "singleton_lock" {{(pid=82253) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 09:20:25 devstack cinder-volume[82253]: DEBUG oslo_concurrency.lockutils [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Releasing lock "singleton_lock" {{(pid=82253) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 09:20:25 devstack cinder-volume[82253]: WARNING amqp [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 22 09:20:25 devstack cinder-volume[82253]: WARNING amqp [None req-7dbcf13b-f58b-4779-8cde-85bdf8e88767 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 22 09:20:26 devstack cinder-volume[82506]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 22 09:20:26 devstack cinder-volume[82506]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 22 09:20:26 devstack cinder-volume[82506]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82506) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 22 09:20:26 devstack cinder-volume[82506]: INFO dbcounter [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Registered counter for database cinder Apr 22 09:20:26 devstack cinder-volume[82506]: DEBUG oslo_db.sqlalchemy.engines [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:20:26 devstack cinder-volume[82506]: DEBUG dbcounter [-] [82506] Writer thread running {{(pid=82506) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 09:20:26 devstack cinder-volume[82506]: INFO cinder.rpc [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 22 09:20:26 devstack cinder-volume[82506]: INFO cinder.rpc [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 22 09:20:26 devstack cinder-volume[82506]: DEBUG oslo_db.sqlalchemy.engines [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:20:27 devstack cinder-volume[82506]: INFO cinder.volume.manager [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Determined volume DB was empty at startup. Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG cinder.volume.manager [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82506) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Apr 22 09:20:27 devstack cinder-volume[82506]: WARNING stevedore.named [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 22 09:20:27 devstack cinder-volume[82506]: WARNING castellan.key_manager [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 09:20:27 devstack cinder-volume[82506]: WARNING cinder.keymgr.conf_key_mgr [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 22 09:20:27 devstack cinder-volume[82506]: INFO cinder.volume.manager [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_db.sqlalchemy.engines [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82506) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:20:27 devstack cinder-volume[82506]: INFO oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Starting 1 workers Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Started child 82642 {{(pid=82506) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Full set of CONF: {{(pid=82506) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] ******************************************************************************** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Configuration options gathered from: {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] ================================================================================ {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] allow_availability_zone_fallback = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] allow_compression_on_image_upload = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82642]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] allowed_direct_url_schemes = [] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] api_rate_limit = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] auth_strategy = keystone {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_availability_zone = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_host = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_name = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_stats_polling_interval = 60 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backup_api_class = cinder.backup.api.API {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backup_name_template = backup-%s {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backup_use_same_host = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backup_use_temp_snapshot = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] chap_password = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] chap_username = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cinder_internal_tenant_project_id = ecf3245bbd8e47b7932f01e68f19ea6d {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cinder_internal_tenant_user_id = d491f8c6a82b4643b2bd4b7e3aea34bf {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cluster = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] compression_format = gzip {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] compute_api_class = cinder.compute.nova.API {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] config_dir = [] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] config_source = [] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] control_exchange = openstack {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] debug = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] default_availability_zone = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] default_group_type = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] default_volume_type = QuobyteHD {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] disk_geometry = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] driver_client_cert = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] driver_client_cert_key = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] driver_data_namespace = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] driver_ssl_cert_path = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] driver_ssl_cert_verify = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] driver_use_ssl = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] enable_new_services = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] enable_unsupported_driver = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] enabled_backends = ['QuobyteHD'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] enforce_multipath_for_image_xfer = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] filter_function = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance_api_insecure = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance_api_servers = ['http://192.168.122.212/image'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance_api_ssl_compression = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance_ca_certificates_file = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance_catalog_info = image:glance:publicURL {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance_certfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance_keyfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance_num_retries = 3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance_request_timeout = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] goodness_function = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] graceful_shutdown_timeout = 5 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] group_api_class = cinder.group.api.API {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] host = devstack {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] image_compress_on_upload = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] image_conversion_address_space_limit = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] image_conversion_cpu_limit = 60 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] image_conversion_disable = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] image_upload_use_cinder_backend = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] image_upload_use_internal_tenant = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] image_volume_cache_enabled = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] image_volume_cache_max_count = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] image_volume_cache_max_size_gb = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] init_host_max_objects_retrieval = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] instance_format = [instance: %(uuid)s] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] iscsi_target_flags = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] iscsi_write_cache = on {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] iser_helper = tgtadm {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] iser_ip_address = 192.168.122.212 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] iser_port = 3260 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] log_color = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] log_config_append = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] log_dir = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] log_file = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] log_options = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] log_rotate_interval = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] log_rotate_interval_type = days {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] log_rotation_type = none {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] max_age = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] max_logfile_count = 30 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] max_logfile_size_mb = 200 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] max_over_subscription_ratio = 20.0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] message_reap_interval = 86400 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] message_ttl = 2592000 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] migration_create_volume_timeout_secs = 300 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] monkey_patch = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] monkey_patch_modules = [] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] my_ip = 192.168.122.212 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] no_snapshot_gb_quota = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] num_iser_scan_tries = 3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] num_shell_tries = 3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] num_volume_device_scan_tries = 3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Starting volume driver QuobyteDriver (1.1.14) Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] nvmeof_conn_info_version = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] nvmet_ns_id = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82642) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:227}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] nvmet_port_id = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] osapi_max_limit = 1000 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] osapi_volume_ext_list = [] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] osapi_volume_listen_port = 8776 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] osapi_volume_use_ssl = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] osapi_volume_workers = 2 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] per_volume_size_limit = -1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] periodic_fuzzy_delay = 60 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] periodic_interval = 60 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] public_endpoint = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] publish_errors = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] quota_backup_gigabytes = 1000 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] quota_backups = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] quota_gigabytes = 1000 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] quota_groups = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] quota_snapshots = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] quota_volumes = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] rate_limit_burst = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] rate_limit_except_level = CRITICAL {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] rate_limit_interval = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] reinit_driver_count = 3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] replication_device = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] report_discard_supported = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] report_interval = 120 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] reservation_clean_interval = 86400 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] reservation_expire = 86400 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] reserved_image_namespaces = [] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] reserved_percentage = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] rpc_response_timeout = 120 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] run_external_periodic_tasks = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] scst_target_driver = iscsi {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] scst_target_iqn_name = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] service_down_time = 720 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] shell_completion = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] snapshot_name_template = snapshot-%s {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] split_loggers = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] state_path = /opt/stack/data/cinder {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] storage_availability_zone = nova {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] storage_protocol = iSCSI {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] syslog_log_facility = LOG_USER {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] target_helper = lioadm {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] target_ip_address = 192.168.122.212 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] target_port = 3260 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] target_protocol = iscsi {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] target_secondary_ip_addresses = [] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] trace_flags = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] transport_url = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] until_refresh = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] use_chap_auth = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] use_default_quota_class = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] use_journal = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] use_json = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] use_multipath_for_image_xfer = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] use_stderr = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] use_syslog = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] verify_glance_signatures = enabled {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_api_class = cinder.volume.api.API {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_backend_name = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_clear = zero {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_clear_ionice = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_clear_size = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_copy_bps_limit = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_dd_blocksize = 1M {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_name_template = volume-%s {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_service_inithost_offload = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volume_usage_audit_period = month {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] zoning_mode = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_concurrency.disable_process_locking = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.admin_password = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.admin_token = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.admin_user = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.auth_port = 35357 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.auth_protocol = https {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.auth_section = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.auth_type = password {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.auth_uri = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.auth_version = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.cache = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.certfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.identity_uri = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.include_service_catalog = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.insecure = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.interface = public {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.keyfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_password = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcache_username = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.region_name = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.service_type = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.212/identity {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.backend = dogpile.cache.null {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.backend_argument = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.backend_expiration_time = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.config_prefix = cache.oslo {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.debug_cache_backend = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.enable_retry_client = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.enable_socket_keepalive = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.enabled = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.enforce_fips_mode = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.expiration_time = 600 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.hashclient_retry_attempts = 2 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.memcache_dead_retry = 300 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.memcache_pool_maxsize = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.memcache_sasl_enabled = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.password = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.proxies = [] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.redis_db = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.redis_server = localhost:6379 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.retry_attempts = 2 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.retry_delay = 0.0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.socket_keepalive_count = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.socket_keepalive_idle = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.socket_keepalive_interval = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.socket_timeout = 1.0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.tls_allowed_ciphers = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.tls_cafile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.tls_certfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.tls_enabled = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.tls_keyfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cache.username = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] coordination.backend_url = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.asyncio_connection = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.asyncio_slave_connection = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.backend = sqlalchemy {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.connection = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.connection_debug = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.connection_parameters = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.connection_recycle_time = 3600 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.connection_trace = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.db_inc_retry_interval = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.db_max_retries = 20 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.db_max_retry_interval = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.db_retry_interval = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.max_overflow = 50 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.max_pool_size = 5 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.max_retries = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.mysql_wsrep_sync_wait = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.pool_timeout = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.retry_interval = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.slave_connection = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.sqlite_synchronous = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.synchronous_reader = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] database.use_db_reconnect = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler.connection_string = messaging:// {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler.enabled = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler.es_doc_type = notification {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler.es_scroll_size = 10000 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler.es_scroll_time = 2m {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler.filter_error_trace = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler.hmac_keys = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler.sentinel_service_name = mymaster {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler.socket_timeout = 0.1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler.trace_requests = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler.trace_sqlalchemy = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler_jaeger.process_tags = {} {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler_jaeger.service_name_prefix = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] profiler_otlp.service_name_prefix = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_policy.enforce_new_defaults = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: WARNING oslo_config.cfg [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_policy.enforce_scope = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_policy.policy_default_rule = default {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_policy.policy_file = policy.yaml {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] privsep_osbrick.group = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] privsep_osbrick.helper_command = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] privsep_osbrick.user = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cinder_sys_admin.group = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cinder_sys_admin.helper_command = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] cinder_sys_admin.user = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] service_user.auth_section = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] service_user.auth_type = password {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] service_user.cafile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] service_user.certfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82642) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] service_user.collect_timing = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] service_user.insecure = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] service_user.keyfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] service_user.send_service_user_token = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] service_user.split_loggers = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] service_user.timeout = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance.auth_section = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.quobyte [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance.auth_type = password {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.quobyte [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance.certfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance.collect_timing = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance.insecure = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance.keyfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance.region_name = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance.split_loggers = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] glance.timeout = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Running cmd (subprocess): mount.quobyte {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.backend_availability_zone = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.chap_password = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.chap_username = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.disk_geometry = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.driver_client_cert = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.driver_client_cert_key = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.driver_data_namespace = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.driver_use_ssl = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.extra_capabilities = {} {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.filter_function = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.goodness_function = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.iscsi_target_flags = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.iscsi_write_cache = on {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.iser_helper = tgtadm {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.iser_ip_address = 192.168.122.212 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.iser_port = 3260 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nas_host = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nas_login = admin {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nas_mount_options = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nas_password = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nas_private_key = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nas_share_path = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.num_shell_tries = 3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.quobyte_volume_url = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.replication_device = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.report_discard_supported = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.reserved_percentage = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.target_helper = tgtadm {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.target_ip_address = 192.168.122.212 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.target_port = 3260 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.target_protocol = iscsi {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.trace_flags = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.unique_fqdn_network = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.use_chap_auth = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.volume_backend_name = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.volume_clear = zero {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.volume_clear_ionice = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.volume_clear_size = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_reports.file_event_handler = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_reports.log_dir = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.backend_availability_zone = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.backend_host = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.chap_password = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.chap_username = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.chiscsi_conf = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.disk_geometry = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.driver_client_cert = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.driver_data_namespace = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.driver_use_ssl = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.extra_capabilities = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.filter_function = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.goodness_function = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.iser_helper = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.iser_ip_address = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.iser_port = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.iser_target_prefix = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nas_host = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nas_login = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nas_mount_options = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nas_password = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nas_private_key = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nas_share_path = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nas_ssh_port = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.num_shell_tries = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.nvmet_port_id = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.replication_device = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.report_discard_supported = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.reserved_percentage = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.scst_target_driver = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.storage_protocol = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.target_helper = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.target_ip_address = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.target_port = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.target_prefix = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.target_protocol = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.trace_flags = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.use_chap_auth = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.volume_clear = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.volume_clear_size = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] QuobyteHD.volumes_dir = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.ssl = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_notifications.driver = [] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_notifications.retry = -1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] key_manager.fixed_key = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.barbican_api_version = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.barbican_endpoint = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.barbican_endpoint_type = public {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.barbican_region_name = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.cafile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.certfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.collect_timing = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.insecure = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.keyfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.number_of_retries = 60 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.retry_delay = 1 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.send_service_user_token = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.split_loggers = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.timeout = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.verify_ssl = True {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican.verify_ssl_path = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican_service_user.auth_section = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican_service_user.auth_type = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican_service_user.cafile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican_service_user.certfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican_service_user.collect_timing = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican_service_user.insecure = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican_service_user.keyfile = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican_service_user.split_loggers = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] barbican_service_user.timeout = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vault.approle_role_id = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vault.approle_secret_id = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vault.kv_mountpoint = secret {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vault.kv_path = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vault.kv_version = 2 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vault.namespace = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vault.root_token_id = **** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vault.ssl_ca_crt_file = None {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vault.timeout = 60.0 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vault.use_ssl = False {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack quobyte-client[82650]: Reading configuration file: /etc/quobyte/client.cfg Apr 22 09:20:27 devstack quobyte-client[82650]: Invalid parameters found, error: missing mount point. Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 22 09:20:27 devstack quobyte-client[82650]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 22 09:20:27 devstack quobyte-client[82650]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 22 09:20:27 devstack cinder-volume[82506]: DEBUG oslo_service.backend._eventlet.service [None req-219585f1-88f7-43f5-957d-c595b899f8b1 None None] ******************************************************************************** {{(pid=82506) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:20:27 devstack sudo[82664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:20:27 devstack sudo[82664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:20:27 devstack sudo[82664]: pam_unix(sudo:session): session closed for user root Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.403s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:20:27 devstack cinder-volume[82642]: INFO cinder.volume.driver [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Driver hasn't implemented _init_vendor_properties() Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG cinder.volume.driver [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82642) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_db.sqlalchemy.engines [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82642) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writer thread running {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG cinder.db.sqlalchemy.api [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Building query based on filter {{(pid=82642) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82642) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1304}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:20:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:20:27 devstack cinder-volume[82642]: INFO cinder.keymgr.migration [None req-48729fd9-b9d3-498f-a8a9-dbeeac255366 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 22 09:20:27 devstack sudo[82710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:20:27 devstack sudo[82710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:20:28 devstack sudo[82710]: pam_unix(sudo:session): session closed for user root Apr 22 09:20:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.411s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:20:28 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:20:28 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Driver initialization completed successfully. Apr 22 09:20:28 devstack cinder-volume[82642]: INFO cinder.manager [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Initiating service 3 cleanup Apr 22 09:20:28 devstack cinder-volume[82642]: INFO cinder.manager [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Service 3 cleanup completed. Apr 22 09:20:28 devstack cinder-volume[82642]: DEBUG cinder.service [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Creating RPC server for service cinder-volume {{(pid=82642) start /opt/stack/cinder/cinder/service.py:231}} Apr 22 09:20:28 devstack cinder-volume[82642]: DEBUG cinder.service [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82642) start /opt/stack/cinder/cinder/service.py:237}} Apr 22 09:20:28 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 22 09:20:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:20:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:20:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:20:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:20:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:20:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:20:28 devstack sudo[82735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:20:28 devstack sudo[82735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:20:28 devstack sudo[82735]: pam_unix(sudo:session): session closed for user root Apr 22 09:20:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.411s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:20:28 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-1e659b98-9395-433f-94fe-c164ba109aec None None] Driver post RPC initialization completed successfully. Apr 22 09:20:37 devstack cinder-volume[82506]: DEBUG dbcounter [-] [82506] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82506) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:20:38 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:20:38 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=2 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Flow 'volume_create_manager' (3d928d3d-0159-4a3a-9d6b-903b7c3a5afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ba0e42-5001-409c-8f99-156748e47a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04ba0e42-5001-409c-8f99-156748e47a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2113972543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a7b8ff-38b6-40e9-84b7-a08a205ccc62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08890d278d94a6ea7cf4645fb3d450e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:21:30Z,use_quota=True,user_id='8e6e55df56f54bb2ac4597e03c097ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa9cb51-90e2-48cc-a731-d66684eaf06c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa9cb51-90e2-48cc-a731-d66684eaf06c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24952cf-2cad-46ea-8197-fc56363715fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f24952cf-2cad-46ea-8197-fc56363715fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92a7b8ff-38b6-40e9-84b7-a08a205ccc62', 'volume_name': 'volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b9d330-5649-4af5-be68-71d345ce08e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79b9d330-5649-4af5-be68-71d345ce08e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74defac-ab9f-4c23-8b4a-c91b93932fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:30 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Volume 92a7b8ff-38b6-40e9-84b7-a08a205ccc62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62', 'volume_size': 1} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2113972543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92a7b8ff-38b6-40e9-84b7-a08a205ccc62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c08890d278d94a6ea7cf4645fb3d450e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:21:30Z,use_quota=True,user_id='8e6e55df56f54bb2ac4597e03c097ddf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Creating volume 92a7b8ff-38b6-40e9-84b7-a08a205ccc62 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:21:30 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:30 devstack sudo[83264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62 1073741824 Apr 22 09:21:30 devstack sudo[83264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG oslo_service.periodic_task [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:21:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:30 devstack sudo[83267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:21:30 devstack sudo[83267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:31 devstack sudo[83267]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.984s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:31 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Flow 'volume_create_manager' (4fe354fc-0c92-45ea-9ed5-c4c5ac091ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a2bfaf-0e4c-49e9-b48b-673821c2a6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49a2bfaf-0e4c-49e9-b48b-673821c2a6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-945525159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9ea73c-cce5-40f1-978f-d3542281fa9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5af94215174a7882cef91cecc1241f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:21:32Z,use_quota=True,user_id='8d2e87e182684bf691e70cd75840a2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fadd2c5-39fd-452b-8a78-1b482af82e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fadd2c5-39fd-452b-8a78-1b482af82e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:32 devstack sudo[83264]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff8da94-4ad3-43e2-909f-cb87d0468d39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fff8da94-4ad3-43e2-909f-cb87d0468d39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e9ea73c-cce5-40f1-978f-d3542281fa9b', 'volume_name': 'volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7adc316e-c53a-495f-8eb6-f8a1132f937e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7adc316e-c53a-495f-8eb6-f8a1132f937e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205495a4-baf8-4c8c-9072-563369753ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:32 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Volume 5e9ea73c-cce5-40f1-978f-d3542281fa9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b', 'volume_size': 1} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62 1073741824" returned: 0 in 1.648s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:32 devstack sudo[83589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62 Apr 22 09:21:32 devstack sudo[83589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:32 devstack sudo[83589]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62" returned: 0 in 0.552s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] <== create_volume: return (2260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.262s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:21:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-945525159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e9ea73c-cce5-40f1-978f-d3542281fa9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd5af94215174a7882cef91cecc1241f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:21:32Z,use_quota=True,user_id='8d2e87e182684bf691e70cd75840a2bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Creating volume 5e9ea73c-cce5-40f1-978f-d3542281fa9b {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:21:32 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:32 devstack sudo[83598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b 1073741824 Apr 22 09:21:32 devstack sudo[83598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b74defac-ab9f-4c23-8b4a-c91b93932fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf09ca8-84b9-42df-bf70-a6cd917235fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:32 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Volume volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62 (92a7b8ff-38b6-40e9-84b7-a08a205ccc62): created successfully Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdf09ca8-84b9-42df-bf70-a6cd917235fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Flow 'volume_create_manager' (3d928d3d-0159-4a3a-9d6b-903b7c3a5afb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:21:32 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6ff3b17d-f4c7-47f4-9fb4-98138fcbd893 tempest-VolumesAdminNegativeTest-1370782814 None] Created volume successfully. Apr 22 09:21:34 devstack sudo[83598]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b 1073741824" returned: 0 in 1.447s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:34 devstack sudo[83607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b Apr 22 09:21:34 devstack sudo[83607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Acquiring lock "cinder-92a7b8ff-38b6-40e9-84b7-a08a205ccc62-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:21:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Lock "cinder-92a7b8ff-38b6-40e9-84b7-a08a205ccc62-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:21:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Acquiring lock "cinder-quobyte-92a7b8ff-38b6-40e9-84b7-a08a205ccc62" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:21:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Lock "cinder-quobyte-92a7b8ff-38b6-40e9-84b7-a08a205ccc62" acquired by "delete_volume" :: waited 0.038s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:21:34 devstack cinder-volume[82642]: INFO oslo.privsep.daemon [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9c3qwcad/privsep.sock'] Apr 22 09:21:34 devstack sudo[83616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9c3qwcad/privsep.sock Apr 22 09:21:34 devstack sudo[83616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:35 devstack sudo[83607]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b" returned: 0 in 1.269s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] <== create_volume: return (2766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:21:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.769s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:21:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205495a4-baf8-4c8c-9072-563369753ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbe212c-4b1d-48d5-adb1-6eceddd99347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:35 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 22 09:21:35 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 09:21:35 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 22 09:21:35 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 09:21:35 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 22 09:21:35 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 22 09:21:35 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 09:21:35 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 09:21:35 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 22 09:21:35 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Volume volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b (5e9ea73c-cce5-40f1-978f-d3542281fa9b): created successfully Apr 22 09:21:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bbe212c-4b1d-48d5-adb1-6eceddd99347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Flow 'volume_create_manager' (4fe354fc-0c92-45ea-9ed5-c4c5ac091ee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:21:35 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-130704e9-7055-4261-b33c-5fec891553fb tempest-DeleteServersTestJSON-941026865 None] Created volume successfully. Apr 22 09:21:36 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 22 09:21:36 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 22 09:21:36 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 22 09:21:36 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 09:21:36 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 22 09:21:36 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 22 09:21:36 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 22 09:21:36 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: Apr 22 09:21:36 devstack cinder-volume[82642]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 22 09:21:37 devstack sudo[83616]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:37 devstack cinder-volume[82642]: INFO oslo.privsep.daemon [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Spawned new privsep daemon via rootwrap Apr 22 09:21:37 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Accepted privsep connection to /tmp/tmp9c3qwcad/privsep.sock {{(pid=82642) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 22 09:21:37 devstack cinder-volume[82642]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 22 09:21:37 devstack cinder-volume[82642]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 22 09:21:37 devstack cinder-volume[82642]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 22 09:21:37 devstack cinder-volume[82642]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83674 Apr 22 09:21:37 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a88516c-6319-4e31-8603-b2d1f08329e0]: (2,) {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:21:37 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[618394a5-68d4-480d-b097-fe79b4786689]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:21:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:37 devstack sudo[83682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62 Apr 22 09:21:37 devstack sudo[83682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:38 devstack sudo[83682]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62" returned: 0 in 1.200s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:38 devstack sudo[83687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62 Apr 22 09:21:38 devstack sudo[83687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:39 devstack sudo[83687]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92a7b8ff-38b6-40e9-84b7-a08a205ccc62" returned: 0 in 1.390s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:39 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Lock "cinder-quobyte-92a7b8ff-38b6-40e9-84b7-a08a205ccc62" released by "delete_volume" :: held 5.173s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:21:39 devstack cinder-volume[82642]: WARNING cinder.quota [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:21:39 devstack cinder-volume[82642]: WARNING cinder.quota [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:21:39 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Created reservations ['dcf3c9aa-e7aa-46cf-9cc8-0228966ada5b', 'afa1126f-aaf5-48ef-bd1a-fc848ec1d59c', 'c69264f3-bc4b-47d5-be28-3414e925a89e', '5ab83eea-2714-4e95-9870-8831445e99a9'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:21:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:21:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:21:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:21:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:21:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:21:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:40 devstack sudo[83691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:21:40 devstack sudo[83691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:41 devstack sudo[83691]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 1.220s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:41 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:21:41 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Deleted volume successfully. Apr 22 09:21:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f54e9e20-e9e3-433c-b120-1754d5fd60ee tempest-VolumesAdminNegativeTest-1370782814 None] Lock "cinder-92a7b8ff-38b6-40e9-84b7-a08a205ccc62-delete_volume" released by "delete_volume" :: held 6.835s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:21:43 devstack cinder-volume[82642]: WARNING py.warnings [req-45caaab9-b263-4644-adc5-2cd795280bfb req-836294ab-2464-481c-82fe-d0dea7bbbfd7 tempest-DeleteServersTestJSON-941026865 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Apr 22 09:21:43 devstack cinder-volume[82642]: .first() Apr 22 09:21:43 devstack cinder-volume[82642]: Apr 22 09:21:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-45caaab9-b263-4644-adc5-2cd795280bfb req-836294ab-2464-481c-82fe-d0dea7bbbfd7 tempest-DeleteServersTestJSON-941026865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:21:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-45caaab9-b263-4644-adc5-2cd795280bfb req-836294ab-2464-481c-82fe-d0dea7bbbfd7 tempest-DeleteServersTestJSON-941026865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:21:43 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d277b004-4b02-4f8d-9f7d-571d39541f71]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:21:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-45caaab9-b263-4644-adc5-2cd795280bfb req-836294ab-2464-481c-82fe-d0dea7bbbfd7 tempest-DeleteServersTestJSON-941026865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:43 devstack sudo[83740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b Apr 22 09:21:43 devstack sudo[83740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:44 devstack sudo[83740]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-45caaab9-b263-4644-adc5-2cd795280bfb req-836294ab-2464-481c-82fe-d0dea7bbbfd7 tempest-DeleteServersTestJSON-941026865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b" returned: 0 in 1.303s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-45caaab9-b263-4644-adc5-2cd795280bfb req-836294ab-2464-481c-82fe-d0dea7bbbfd7 tempest-DeleteServersTestJSON-941026865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.365s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:21:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-45caaab9-b263-4644-adc5-2cd795280bfb req-836294ab-2464-481c-82fe-d0dea7bbbfd7 tempest-DeleteServersTestJSON-941026865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38', 'name': 'volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea9f9b2f-98fb-4983-8d9f-1e440ac500e9', 'enforce_multipath': True} {{(pid=82642) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4958}} Apr 22 09:21:45 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-45caaab9-b263-4644-adc5-2cd795280bfb req-836294ab-2464-481c-82fe-d0dea7bbbfd7 tempest-DeleteServersTestJSON-941026865 None] attachment_update completed successfully. Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Flow 'volume_create_manager' (0330cca4-c100-4a0a-8887-6e458ddcd09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3975cf-cc51-419e-97e7-2746dcf56537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc3975cf-cc51-419e-97e7-2746dcf56537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:21:54Z,deleted=False,deleted_at=None,display_description='',display_name='d275e742-4dc8-4ac3-be5c-9468e3f3e00e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddce9a03101f44849a16972e1d90a767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:21:54Z,use_quota=True,user_id='97f09d8e55304c0ebb39d8fbd1bfb73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1d6391-d7a9-4074-a574-5e95f79c44e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d1d6391-d7a9-4074-a574-5e95f79c44e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88856be0-e53e-4ffc-bd8e-d2f53cbe13bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88856be0-e53e-4ffc-bd8e-d2f53cbe13bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e', 'volume_name': 'volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a1d6e8-86cb-4bae-a056-b17e5c546e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a1d6e8-86cb-4bae-a056-b17e5c546e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1c5514-9597-4d33-a66e-94de6a08e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:54 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Volume ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e', 'volume_size': 1} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:21:54Z,deleted=False,deleted_at=None,display_description='',display_name='d275e742-4dc8-4ac3-be5c-9468e3f3e00e-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddce9a03101f44849a16972e1d90a767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:21:54Z,use_quota=True,user_id='97f09d8e55304c0ebb39d8fbd1bfb73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Creating volume ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:21:54 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:21:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:54 devstack sudo[84241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e 1073741824 Apr 22 09:21:54 devstack sudo[84241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:55 devstack sudo[84241]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e 1073741824" returned: 0 in 0.848s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:55 devstack sudo[84250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e Apr 22 09:21:55 devstack sudo[84250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:55 devstack sudo[84250]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e" returned: 0 in 0.562s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:21:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.442s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:21:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1c5514-9597-4d33-a66e-94de6a08e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36325791-951e-4ffc-ab69-d6a447cd85a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:21:55 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Volume volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e (ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e): created successfully Apr 22 09:21:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36325791-951e-4ffc-ab69-d6a447cd85a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:21:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Flow 'volume_create_manager' (0330cca4-c100-4a0a-8887-6e458ddcd09b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:21:55 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-2c05a324-8fee-40c9-91a5-b8faeb6c48bb tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Created volume successfully. Apr 22 09:21:56 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-927698c7-5c70-4390-91fa-5cf6d0ec2477 req-c2cc3c3e-daa9-451a-a8b9-ea08c1e37221 tempest-DeleteServersTestJSON-941026865 None] Terminate volume connection completed successfully. Apr 22 09:21:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-927698c7-5c70-4390-91fa-5cf6d0ec2477 req-c2cc3c3e-daa9-451a-a8b9-ea08c1e37221 tempest-DeleteServersTestJSON-941026865 None] Deleting attachment ea9f9b2f-98fb-4983-8d9f-1e440ac500e9. {{(pid=82642) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5089}} Apr 22 09:21:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-b205c8d5-3345-4359-840e-e7134130cdc3 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:21:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-b205c8d5-3345-4359-840e-e7134130cdc3 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:21:57 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[362055b5-f115-47f3-98f8-336b7f9c1541]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:21:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-b205c8d5-3345-4359-840e-e7134130cdc3 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:21:57 devstack sudo[84284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e Apr 22 09:21:57 devstack sudo[84284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:21:58 devstack sudo[84284]: pam_unix(sudo:session): session closed for user root Apr 22 09:21:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-b205c8d5-3345-4359-840e-e7134130cdc3 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e" returned: 0 in 0.610s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:21:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-b205c8d5-3345-4359-840e-e7134130cdc3 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.632s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:21:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-b205c8d5-3345-4359-840e-e7134130cdc3 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38', 'name': 'volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2f88efc-200f-49f1-8149-6dcb527d1fe1', 'enforce_multipath': True} {{(pid=82642) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4958}} Apr 22 09:21:58 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-def235bb-27eb-4420-b3e4-b0e11e8ba7c7 req-b205c8d5-3345-4359-840e-e7134130cdc3 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] attachment_update completed successfully. Apr 22 09:22:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Acquiring lock "cinder-5e9ea73c-cce5-40f1-978f-d3542281fa9b-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Lock "cinder-5e9ea73c-cce5-40f1-978f-d3542281fa9b-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Acquiring lock "cinder-quobyte-5e9ea73c-cce5-40f1-978f-d3542281fa9b" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Lock "cinder-quobyte-5e9ea73c-cce5-40f1-978f-d3542281fa9b" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:00 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56c5937-e971-4d7d-b8d5-5907c03ef1b6]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:00 devstack sudo[84293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b Apr 22 09:22:00 devstack sudo[84293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:00 devstack sudo[84293]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b" returned: 0 in 0.636s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:00 devstack sudo[84372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b Apr 22 09:22:00 devstack sudo[84372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:01 devstack sudo[84372]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5e9ea73c-cce5-40f1-978f-d3542281fa9b" returned: 0 in 0.659s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Lock "cinder-quobyte-5e9ea73c-cce5-40f1-978f-d3542281fa9b" released by "delete_volume" :: held 1.357s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:01 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Created reservations ['8c24fffe-6c5d-4b67-b9fa-bd524f543971', '97bf6ac6-1665-4280-938a-8fa54500bfa6', '53250a95-2886-45fe-b977-b8a938ed5f09', '21fa06a0-6cbc-488d-8ab0-07b16696e6c6'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:22:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:01 devstack sudo[84411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:22:01 devstack sudo[84411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:02 devstack sudo[84411]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.996s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:02 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:22:02 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Deleted volume successfully. Apr 22 09:22:02 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d1a4e5a-c2e0-489e-8cff-47824733c54c tempest-DeleteServersTestJSON-941026865 None] Lock "cinder-5e9ea73c-cce5-40f1-978f-d3542281fa9b-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Flow 'volume_create_manager' (d8d8ab8b-0324-4e0d-a4f1-5f566a405c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3fd5c7-8eae-4fe2-bede-a8d7b4d28d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e3fd5c7-8eae-4fe2-bede-a8d7b4d28d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-104507802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524fd3fb-8b6c-431e-a6d8-b64a79b2a093,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05ee840c2b7a451487258d62e8e79343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:07Z,use_quota=True,user_id='244023ce9f0841dd92539da58b722391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08971a6a-7676-41e8-b375-b4c244a262cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08971a6a-7676-41e8-b375-b4c244a262cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6b1256-5882-4482-a165-314db8faeb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c6b1256-5882-4482-a165-314db8faeb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '524fd3fb-8b6c-431e-a6d8-b64a79b2a093', 'volume_name': 'volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6c0a27-b7ce-4fff-9b51-29274efdf707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6c0a27-b7ce-4fff-9b51-29274efdf707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9d8256-d25c-420a-8b3f-5ff9a292e3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:07 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Volume 524fd3fb-8b6c-431e-a6d8-b64a79b2a093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093', 'volume_size': 1} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:22:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-104507802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=524fd3fb-8b6c-431e-a6d8-b64a79b2a093,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='05ee840c2b7a451487258d62e8e79343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:07Z,use_quota=True,user_id='244023ce9f0841dd92539da58b722391',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Creating volume 524fd3fb-8b6c-431e-a6d8-b64a79b2a093 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:22:07 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:22:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:07 devstack sudo[84846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093 1073741824 Apr 22 09:22:07 devstack sudo[84846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:08 devstack sudo[84846]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093 1073741824" returned: 0 in 0.727s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:08 devstack sudo[84853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093 Apr 22 09:22:08 devstack sudo[84853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:09 devstack sudo[84853]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093" returned: 0 in 0.663s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:22:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.426s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c9d8256-d25c-420a-8b3f-5ff9a292e3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1b3d6f-6da9-41cc-b94a-326b0d1f23dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:09 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Volume volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093 (524fd3fb-8b6c-431e-a6d8-b64a79b2a093): created successfully Apr 22 09:22:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef1b3d6f-6da9-41cc-b94a-326b0d1f23dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Flow 'volume_create_manager' (d8d8ab8b-0324-4e0d-a4f1-5f566a405c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:09 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-8c75dd70-6af3-4758-a3ed-d5a6376ee8c4 req-5069ab48-32af-470c-b69b-8b4b3c9339d3 tempest-VolumesGetTestJSON-291213317 None] Created volume successfully. Apr 22 09:22:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Acquiring lock "cinder-524fd3fb-8b6c-431e-a6d8-b64a79b2a093-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Lock "cinder-524fd3fb-8b6c-431e-a6d8-b64a79b2a093-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Acquiring lock "cinder-quobyte-524fd3fb-8b6c-431e-a6d8-b64a79b2a093" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Lock "cinder-quobyte-524fd3fb-8b6c-431e-a6d8-b64a79b2a093" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:10 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fc3e9f-cb4c-4a1c-b9b2-8c5c8205e0ed]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:10 devstack sudo[84859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093 Apr 22 09:22:10 devstack sudo[84859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Flow 'volume_create_manager' (849261b7-158b-48b7-a8c8-80eb1f2e0cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:11 devstack sudo[84859]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5f91c1-3c26-43b1-a05d-d7400008b2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093" returned: 0 in 0.771s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5f91c1-3c26-43b1-a05d-d7400008b2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1866005628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68024000-ee1e-4afc-b793-6cc351083bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0042797a5314d3781863cd060a24015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:11Z,use_quota=True,user_id='2357701d124e4af5a63618efa60a8fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:11 devstack sudo[84867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093 Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be5bd5b-fbec-494b-9fc8-dac7f53ae2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:11 devstack sudo[84867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8be5bd5b-fbec-494b-9fc8-dac7f53ae2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa28175e-1bcc-4030-9b6d-80b56cba65c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa28175e-1bcc-4030-9b6d-80b56cba65c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68024000-ee1e-4afc-b793-6cc351083bf9', 'volume_name': 'volume-68024000-ee1e-4afc-b793-6cc351083bf9', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65527d8-7188-46cc-83e6-82ca6e1f2bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e65527d8-7188-46cc-83e6-82ca6e1f2bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74940a35-ece7-46a3-be58-ec9532ba74e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:11 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Volume 68024000-ee1e-4afc-b793-6cc351083bf9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68024000-ee1e-4afc-b793-6cc351083bf9', 'volume_size': 1} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1866005628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68024000-ee1e-4afc-b793-6cc351083bf9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0042797a5314d3781863cd060a24015',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:11Z,use_quota=True,user_id='2357701d124e4af5a63618efa60a8fdb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Creating volume 68024000-ee1e-4afc-b793-6cc351083bf9 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:22:11 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:22:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:11 devstack sudo[84869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 1073741824 Apr 22 09:22:11 devstack sudo[84869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:12 devstack sudo[84867]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-524fd3fb-8b6c-431e-a6d8-b64a79b2a093" returned: 0 in 0.677s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Lock "cinder-quobyte-524fd3fb-8b6c-431e-a6d8-b64a79b2a093" released by "delete_volume" :: held 1.475s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG cinder.quota [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Created reservations ['4164f462-459f-41ca-b5d5-2852aa981a12', '49c02423-9d1c-4f24-b7e8-380fc36259fc', 'a7f46ebe-829b-4a5a-b2f9-1588e047cf09', '7e6ddc7a-0efc-44c2-a171-3073bfbf702b'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:12 devstack sudo[84872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:22:12 devstack sudo[84872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:12 devstack sudo[84869]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 1073741824" returned: 0 in 1.065s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:12 devstack sudo[84877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 Apr 22 09:22:12 devstack sudo[84877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:12 devstack sudo[84872]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.538s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG cinder.manager [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:22:12 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Deleted volume successfully. Apr 22 09:22:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-aa50300b-4291-4589-97bb-1ba8ea505b3d req-65a794a6-5f2d-466c-9fa5-c5c04dbdea20 tempest-VolumesGetTestJSON-291213317 None] Lock "cinder-524fd3fb-8b6c-431e-a6d8-b64a79b2a093-delete_volume" released by "delete_volume" :: held 2.205s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:13 devstack sudo[84877]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9" returned: 0 in 0.921s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:22:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74940a35-ece7-46a3-be58-ec9532ba74e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68024000-ee1e-4afc-b793-6cc351083bf9', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c5fc75-8fdd-46e7-87db-825f05052f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:13 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Volume volume-68024000-ee1e-4afc-b793-6cc351083bf9 (68024000-ee1e-4afc-b793-6cc351083bf9): created successfully Apr 22 09:22:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c5fc75-8fdd-46e7-87db-825f05052f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Flow 'volume_create_manager' (849261b7-158b-48b7-a8c8-80eb1f2e0cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:13 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-9c64eeb7-bfeb-4b80-95d4-3deb4eb406dc req-7d0e6a49-8b55-4fc6-bbb9-7b9b325330a1 tempest-VolumesSnapshotsTestJSON-1854514838 None] Created volume successfully. Apr 22 09:22:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] Creating offline snapshot aa89bcac-9b25-418c-8166-a3812e412d93 of volume 68024000-ee1e-4afc-b793-6cc351083bf9 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:22:15 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c5cc37-9f6e-41c7-8e87-79ed523ec3e9]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:15 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 Apr 22 09:22:15 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:15 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9" returned: 0 in 0.544s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:16 devstack sudo[84946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 1G Apr 22 09:22:16 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:16 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 1G" returned: 0 in 0.581s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68024000-ee1e-4afc-b793-6cc351083bf9 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:16 devstack sudo[84957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68024000-ee1e-4afc-b793-6cc351083bf9 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 Apr 22 09:22:16 devstack sudo[84957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c7152efc-43d9-4658-a103-d14aaf27e881 tempest-GroupSnapshotsV319Test-484534430 None] Group tempest-GroupSnapshotsV319Test-Group-1995479920: creating Apr 22 09:22:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c7152efc-43d9-4658-a103-d14aaf27e881 tempest-GroupSnapshotsV319Test-484534430 None] Group tempest-GroupSnapshotsV319Test-Group-1995479920: created successfully Apr 22 09:22:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c7152efc-43d9-4658-a103-d14aaf27e881 tempest-GroupSnapshotsV319Test-484534430 None] Create group completed successfully. Apr 22 09:22:17 devstack sudo[84957]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68024000-ee1e-4afc-b793-6cc351083bf9 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93" returned: 0 in 0.720s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:17 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 is being set with open permissions: ugo+rw Apr 22 09:22:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:17 devstack sudo[84980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 Apr 22 09:22:17 devstack sudo[84980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:17 devstack sudo[84980]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93" returned: 0 in 0.429s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:17 devstack sudo[84986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.info Apr 22 09:22:17 devstack sudo[84986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:18 devstack sudo[84986]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.info" returned: 0 in 0.450s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:18 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.info is being set with open permissions: ugo+rw Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:18 devstack sudo[84989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.info Apr 22 09:22:18 devstack sudo[84989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Flow 'volume_create_manager' (5f800194-166d-4994-bb1a-ca31a4b39415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffde40d0-6027-49e8-b0ba-04166bd9e2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffde40d0-6027-49e8-b0ba-04166bd9e2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-995137190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94da9162-8ea0-4ade-b3a6-7e3dc305ae27,host='devstack@QuobyteHD#QuobyteHD',id=ca145ffd-26aa-4a91-aa77-84bc64b7c958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fd799a4b214ad5b76981807def4944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:18Z,use_quota=True,user_id='d32f32fe9d254b65bfcfd14ad4e22013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84d8d7ff-3daf-4e04-9b88-ed16230655fc),volume_type_id=84d8d7ff-3daf-4e04-9b88-ed16230655fc)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3864e4a-5ca2-4bc9-8d10-f08bdd33325e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3864e4a-5ca2-4bc9-8d10-f08bdd33325e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6d39d1-fea8-4322-80f7-41846752dc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc6d39d1-fea8-4322-80f7-41846752dc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca145ffd-26aa-4a91-aa77-84bc64b7c958', 'volume_name': 'volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63ae0c9-a462-4cf4-ae70-6ae94bf98fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b63ae0c9-a462-4cf4-ae70-6ae94bf98fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddea92c1-3849-4f9a-867d-bf9e94ea7854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:18 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Volume ca145ffd-26aa-4a91-aa77-84bc64b7c958: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958', 'volume_size': 1} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:18 devstack sudo[84989]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.info" returned: 0 in 0.452s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.236s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.177s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=94da9162-8ea0-4ade-b3a6-7e3dc305ae27,created_at=2026-04-22T07:22:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-995137190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=94da9162-8ea0-4ade-b3a6-7e3dc305ae27,host='devstack@QuobyteHD#QuobyteHD',id=ca145ffd-26aa-4a91-aa77-84bc64b7c958,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3fd799a4b214ad5b76981807def4944',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:18Z,use_quota=True,user_id='d32f32fe9d254b65bfcfd14ad4e22013',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84d8d7ff-3daf-4e04-9b88-ed16230655fc),volume_type_id=84d8d7ff-3daf-4e04-9b88-ed16230655fc)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Creating volume ca145ffd-26aa-4a91-aa77-84bc64b7c958 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:22:18 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:18 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-bf51bb0f-c393-4f96-96c3-31062e9c372f req-74752574-aff5-45e2-97d5-e278b6af8f48 tempest-VolumesSnapshotsTestJSON-1854514838 None] Create snapshot completed successfully Apr 22 09:22:18 devstack sudo[84993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 1073741824 Apr 22 09:22:18 devstack sudo[84993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Acquiring lock "cinder-aa89bcac-9b25-418c-8166-a3812e412d93-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "cinder-aa89bcac-9b25-418c-8166-a3812e412d93-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Acquiring lock "cinder-quobyte-68024000-ee1e-4afc-b793-6cc351083bf9" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "cinder-quobyte-68024000-ee1e-4afc-b793-6cc351083bf9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Acquiring lock "cinder-quobyte-aa89bcac-9b25-418c-8166-a3812e412d93" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "cinder-quobyte-aa89bcac-9b25-418c-8166-a3812e412d93" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Deleting offline snapshot aa89bcac-9b25-418c-8166-a3812e412d93 of volume 68024000-ee1e-4afc-b793-6cc351083bf9 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] snapshot_file for this snap is: volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6804300-252d-44b7-904b-98d813113e5f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:19 devstack sudo[84995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 Apr 22 09:22:19 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:19 devstack sudo[84993]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 1073741824" returned: 0 in 0.559s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:19 devstack sudo[85000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 Apr 22 09:22:19 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:19 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93" returned: 0 in 0.550s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68024000-ee1e-4afc-b793-6cc351083bf9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fe90900-17e3-47f8-9726-cd5faf99aa5e]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:19 devstack sudo[85005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 Apr 22 09:22:19 devstack sudo[85005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:19 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958" returned: 0 in 0.427s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddea92c1-3849-4f9a-867d-bf9e94ea7854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b2e8fa-7f1d-418d-89e2-2e4041b265a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:19 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Volume volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 (ca145ffd-26aa-4a91-aa77-84bc64b7c958): created successfully Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7b2e8fa-7f1d-418d-89e2-2e4041b265a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Flow 'volume_create_manager' (5f800194-166d-4994-bb1a-ca31a4b39415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:19 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f9e5d10f-670a-492f-bb98-55155d3cc65a tempest-GroupSnapshotsV319Test-484534430 None] Created volume successfully. Apr 22 09:22:20 devstack sudo[85005]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9" returned: 0 in 0.526s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:20 devstack sudo[85012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 Apr 22 09:22:20 devstack sudo[85012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:20 devstack sudo[85012]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:20 devstack sudo[85047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93 Apr 22 09:22:20 devstack sudo[85047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:20 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] GroupSnapshot 66a84a14-2425-4a97-b2fd-e5c404f2d4bb: creating. Apr 22 09:22:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] Group snapshot 66a84a14-2425-4a97-b2fd-e5c404f2d4bb: creating. {{(pid=82642) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4209}} Apr 22 09:22:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] Creating offline snapshot 9ad693ec-93b1-41ff-8dce-fd3afcede24b of volume ca145ffd-26aa-4a91-aa77-84bc64b7c958 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:22:20 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[db8ca780-aea0-4a3d-856a-f6d67edfaa2b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:20 devstack sudo[85053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 Apr 22 09:22:20 devstack sudo[85053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:21 devstack sudo[85047]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9.aa89bcac-9b25-418c-8166-a3812e412d93" returned: 0 in 0.503s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "cinder-quobyte-aa89bcac-9b25-418c-8166-a3812e412d93" released by "_delete_snapshot" :: held 2.166s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "cinder-quobyte-68024000-ee1e-4afc-b793-6cc351083bf9" released by "delete_snapshot" :: held 2.185s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:21 devstack cinder-volume[82642]: WARNING cinder.quota [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:22:21 devstack cinder-volume[82642]: DEBUG cinder.quota [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Created reservations ['359bccc1-7eec-4ac8-a5d3-8e91f2357c6e', '62d0931b-67fd-4c2a-887e-536379bec211', '8299abe1-c7f5-46c7-a4a2-0fba665cea60', '72ca733a-e5b5-4d8e-83cd-a1d91ed163d3'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:22:21 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Delete snapshot completed successfully. Apr 22 09:22:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-dff8a00a-54fb-4cef-b8bb-03b131271bff req-3109867b-64c6-4a05-9317-131963f7fd56 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "cinder-aa89bcac-9b25-418c-8166-a3812e412d93-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:21 devstack sudo[85053]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958" returned: 0 in 0.632s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:21 devstack sudo[85085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b 1G Apr 22 09:22:21 devstack sudo[85085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:22 devstack sudo[85085]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b 1G" returned: 0 in 0.598s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:22 devstack sudo[85096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b Apr 22 09:22:22 devstack sudo[85096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Acquiring lock "cinder-68024000-ee1e-4afc-b793-6cc351083bf9-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "cinder-68024000-ee1e-4afc-b793-6cc351083bf9-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Acquiring lock "cinder-quobyte-68024000-ee1e-4afc-b793-6cc351083bf9" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "cinder-quobyte-68024000-ee1e-4afc-b793-6cc351083bf9" acquired by "delete_volume" :: waited 0.041s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a278f7e-532c-42ba-8740-9c6507bd6899]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:22 devstack sudo[85101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 Apr 22 09:22:22 devstack sudo[85101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:22 devstack sudo[85096]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b" returned: 0 in 0.576s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:22 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:22 devstack sudo[85110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b Apr 22 09:22:22 devstack sudo[85110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:22 devstack sudo[85101]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9" returned: 0 in 0.610s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:22 devstack sudo[85122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9 Apr 22 09:22:22 devstack sudo[85122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:23 devstack sudo[85110]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b" returned: 0 in 0.835s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:23 devstack sudo[85155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.info Apr 22 09:22:23 devstack sudo[85155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:23 devstack sudo[85122]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-68024000-ee1e-4afc-b793-6cc351083bf9" returned: 0 in 0.672s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "cinder-quobyte-68024000-ee1e-4afc-b793-6cc351083bf9" released by "delete_volume" :: held 1.345s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:23 devstack cinder-volume[82642]: DEBUG cinder.quota [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Created reservations ['6458a135-d3d1-4967-b372-604431931e0d', 'f4e8be16-6d45-4d64-9bd6-0e9bb34afb8b', '8cb6eda9-626c-4d8a-bc21-e128f0fc2664', '75a753bf-bf7b-4523-9aba-1854f3549c7e'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:22:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:23 devstack sudo[85168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:22:23 devstack sudo[85168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:24 devstack sudo[85155]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.info" returned: 0 in 0.863s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:24 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:22:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:24 devstack sudo[85173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.info Apr 22 09:22:24 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:24 devstack sudo[85168]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.687s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:24 devstack cinder-volume[82642]: DEBUG cinder.manager [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:22:24 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Deleted volume successfully. Apr 22 09:22:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-97506bc6-3107-4e1b-9fa4-6f4a785a41d4 req-c8d0af95-6211-40ef-b099-071eb301d3f2 tempest-VolumesSnapshotsTestJSON-1854514838 None] Lock "cinder-68024000-ee1e-4afc-b793-6cc351083bf9-delete_volume" released by "delete_volume" :: held 2.327s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:25 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.info" returned: 0 in 0.789s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.374s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:25 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-cc05f4c3-9934-4062-9320-c0d0634b6a63 tempest-GroupSnapshotsV319Test-484534430 None] group_snapshot 66a84a14-2425-4a97-b2fd-e5c404f2d4bb: created successfully Apr 22 09:22:26 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Flow 'volume_create_manager' (9cb31047-6296-4399-9c4a-2abb50568c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09385885-7da2-4607-9a7e-5f2144730d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09385885-7da2-4607-9a7e-5f2144730d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1026524868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c3b068-b7ee-4289-8295-2b74d2a3bf8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3e764e31c94e8f853b3be223199159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:27Z,use_quota=True,user_id='b39a85825c294ce6ba6446013ea57061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b43f0b1-ea7f-48a6-9635-44b7a528f1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b43f0b1-ea7f-48a6-9635-44b7a528f1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5fc8b1-62b8-4df5-81b3-17d427508611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5fc8b1-62b8-4df5-81b3-17d427508611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c3b068-b7ee-4289-8295-2b74d2a3bf8d', 'volume_name': 'volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb27c6f6-0e58-41ae-a1c6-160f8a3b58d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb27c6f6-0e58-41ae-a1c6-160f8a3b58d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d09c476-76bb-4317-a030-53ebd01a089c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:27 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Volume 56c3b068-b7ee-4289-8295-2b74d2a3bf8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d', 'volume_size': 1} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1026524868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c3b068-b7ee-4289-8295-2b74d2a3bf8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b3e764e31c94e8f853b3be223199159',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:27Z,use_quota=True,user_id='b39a85825c294ce6ba6446013ea57061',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Creating volume 56c3b068-b7ee-4289-8295-2b74d2a3bf8d {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:22:27 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:27 devstack sudo[85180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d 1073741824 Apr 22 09:22:27 devstack sudo[85180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:27 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] group_snapshot 66a84a14-2425-4a97-b2fd-e5c404f2d4bb: deleting Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] group_snapshot 66a84a14-2425-4a97-b2fd-e5c404f2d4bb: deleting {{(pid=82642) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4384}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Acquiring lock "cinder-quobyte-ca145ffd-26aa-4a91-aa77-84bc64b7c958" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Lock "cinder-quobyte-ca145ffd-26aa-4a91-aa77-84bc64b7c958" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Acquiring lock "cinder-quobyte-9ad693ec-93b1-41ff-8dce-fd3afcede24b" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Lock "cinder-quobyte-9ad693ec-93b1-41ff-8dce-fd3afcede24b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Deleting offline snapshot 9ad693ec-93b1-41ff-8dce-fd3afcede24b of volume ca145ffd-26aa-4a91-aa77-84bc64b7c958 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] snapshot_file for this snap is: volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8883d6dd-07ff-4969-b308-dbbcaa6ddfce]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:27 devstack sudo[85182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b Apr 22 09:22:27 devstack sudo[85182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:28 devstack sudo[85180]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d 1073741824" returned: 0 in 1.295s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:28 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=64,cinder:UPDATE=56,cinder:DELETE=7,cinder:INSERT=13 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:22:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:28 devstack sudo[85206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d Apr 22 09:22:28 devstack sudo[85206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:28 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:UPDATE=74,cinder:SELECT=64,cinder:INSERT=16,cinder:DELETE=4 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:22:28 devstack sudo[85182]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b" returned: 0 in 1.241s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:22:28 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc28a4a3-af3f-484f-b25e-f9ce89d0cac4]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:28 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 Apr 22 09:22:28 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:30 devstack sudo[85206]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d" returned: 0 in 1.434s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] <== create_volume: return (2848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.855s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d09c476-76bb-4317-a030-53ebd01a089c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4fa679-e9e0-4c47-af67-f1e6791a87a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:30 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Volume volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d (56c3b068-b7ee-4289-8295-2b74d2a3bf8d): created successfully Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4fa679-e9e0-4c47-af67-f1e6791a87a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Flow 'volume_create_manager' (9cb31047-6296-4399-9c4a-2abb50568c2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:30 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-eab2bdb6-2056-480c-b316-851b41974155 tempest-ServerRescueNegativeTestJSON-999136373 None] Created volume successfully. Apr 22 09:22:30 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958" returned: 0 in 1.453s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:30 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b Apr 22 09:22:30 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG oslo_service.periodic_task [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:30 devstack sudo[85283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:22:30 devstack sudo[85283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-51d34443-cc1f-4963-9478-694395db001b tempest-BackendsCapabilitiesAdminTestsJSON-565581479 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82642) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4864}} Apr 22 09:22:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f62ce51c-8633-43a2-a382-41b753f7b495 tempest-BackendsCapabilitiesAdminTestsJSON-565581479 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7327919006348, 'free_capacity_gb': 1775.7327919006348, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82642) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4864}} Apr 22 09:22:31 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b" returned: 0 in 1.274s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:31 devstack sudo[85297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b Apr 22 09:22:31 devstack sudo[85297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:31 devstack sudo[85283]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 1.086s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:31 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:22:32 devstack sudo[85297]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958.9ad693ec-93b1-41ff-8dce-fd3afcede24b" returned: 0 in 1.016s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Lock "cinder-quobyte-9ad693ec-93b1-41ff-8dce-fd3afcede24b" released by "_delete_snapshot" :: held 5.169s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Lock "cinder-quobyte-ca145ffd-26aa-4a91-aa77-84bc64b7c958" released by "delete_snapshot" :: held 5.201s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:32 devstack cinder-volume[82642]: WARNING cinder.quota [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1899156318 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1899156318, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:22:32 devstack cinder-volume[82642]: WARNING cinder.quota [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1899156318 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1899156318, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:22:32 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] Created reservations ['fd032821-8f77-418f-a9b8-bb67c54d349e', '987e12a2-5f0c-4b70-a044-f193a59efb95', 'a7a6a225-8f5c-48f8-ac6f-d4a4333d97b9', '2649680e-1092-4802-bd45-d34a6bea6863'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:22:32 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-93b05f2d-f10e-4c34-8539-f0da78a16df2 tempest-GroupSnapshotsV319Test-484534430 None] group_snapshot 66a84a14-2425-4a97-b2fd-e5c404f2d4bb: deleted successfully Apr 22 09:22:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Acquiring lock "cinder-quobyte-ca145ffd-26aa-4a91-aa77-84bc64b7c958" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Lock "cinder-quobyte-ca145ffd-26aa-4a91-aa77-84bc64b7c958" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:33 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8bbcb8-3584-4448-bcd1-8b8fa251b085]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:33 devstack sudo[85344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 Apr 22 09:22:33 devstack sudo[85344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:34 devstack sudo[85344]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958" returned: 0 in 1.016s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:34 devstack sudo[85358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958 Apr 22 09:22:34 devstack sudo[85358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:35 devstack sudo[85358]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ca145ffd-26aa-4a91-aa77-84bc64b7c958" returned: 0 in 0.601s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Lock "cinder-quobyte-ca145ffd-26aa-4a91-aa77-84bc64b7c958" released by "delete_volume" :: held 1.658s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:35 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Created reservations ['b1b38576-53c8-4a63-8738-fed1d19cca86'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:22:35 devstack cinder-volume[82642]: WARNING cinder.quota [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1899156318 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1899156318, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:22:35 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Created reservations ['5c9ed335-bb6b-436d-bd08-cbe3b135c03e', '8f688492-eea9-4af4-807d-436308bbc835', '7982ae9f-32a1-42ca-9cd2-972f0bbec44d', '65716205-8fe8-4f19-805e-b70549b4298e'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:22:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:35 devstack sudo[85382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:22:35 devstack sudo[85382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:36 devstack sudo[85382]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.543s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:36 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:22:36 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b3208175-3244-4d4b-92b4-4e54e03a5d89 tempest-GroupSnapshotsV319Test-484534430 None] Delete group completed successfully. Apr 22 09:22:37 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4db55afc-9fa1-4692-9898-e69230659338 tempest-GroupSnapshotsTest-859463721 None] Group tempest-GroupSnapshotsTest-Group-679957538: creating Apr 22 09:22:37 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4db55afc-9fa1-4692-9898-e69230659338 tempest-GroupSnapshotsTest-859463721 None] Group tempest-GroupSnapshotsTest-Group-679957538: created successfully Apr 22 09:22:37 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4db55afc-9fa1-4692-9898-e69230659338 tempest-GroupSnapshotsTest-859463721 None] Create group completed successfully. Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Flow 'volume_create_manager' (c9a74fc9-d07b-4bcf-a180-c48a99cee3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b5d0e6-8526-4579-9086-4ac474ec833f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87b5d0e6-8526-4579-9086-4ac474ec833f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2131645724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2a58482-8310-475d-9fb4-d17508556a84,host='devstack@QuobyteHD#QuobyteHD',id=b5a86431-2203-4888-b3c6-29982a99d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11700ff62a149bc852fe3aaaa140e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:39Z,use_quota=True,user_id='6e6b03f4807f4ac7aefd189227dfa60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5eff766-9aa6-4e88-9af0-c949c7fe335c),volume_type_id=f5eff766-9aa6-4e88-9af0-c949c7fe335c)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ac0288-87d0-4948-ac41-ffe68c3e2ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41ac0288-87d0-4948-ac41-ffe68c3e2ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14bc960-8ac3-4358-bb8d-6165921a30ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b14bc960-8ac3-4358-bb8d-6165921a30ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a86431-2203-4888-b3c6-29982a99d626', 'volume_name': 'volume-b5a86431-2203-4888-b3c6-29982a99d626', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a4599c-d94d-4fa5-a65b-e4da99ea7628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2a4599c-d94d-4fa5-a65b-e4da99ea7628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a44dbea-30b5-4929-94c9-51f3998b9948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:38 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Volume b5a86431-2203-4888-b3c6-29982a99d626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a86431-2203-4888-b3c6-29982a99d626', 'volume_size': 1} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c2a58482-8310-475d-9fb4-d17508556a84,created_at=2026-04-22T07:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2131645724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c2a58482-8310-475d-9fb4-d17508556a84,host='devstack@QuobyteHD#QuobyteHD',id=b5a86431-2203-4888-b3c6-29982a99d626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11700ff62a149bc852fe3aaaa140e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:39Z,use_quota=True,user_id='6e6b03f4807f4ac7aefd189227dfa60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f5eff766-9aa6-4e88-9af0-c949c7fe335c),volume_type_id=f5eff766-9aa6-4e88-9af0-c949c7fe335c)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Creating volume b5a86431-2203-4888-b3c6-29982a99d626 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:22:38 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:22:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:38 devstack sudo[85433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 1073741824 Apr 22 09:22:38 devstack sudo[85433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:39 devstack sudo[85433]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 1073741824" returned: 0 in 0.643s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:39 devstack sudo[85439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 Apr 22 09:22:39 devstack sudo[85439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:40 devstack sudo[85439]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626" returned: 0 in 0.490s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:22:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a44dbea-30b5-4929-94c9-51f3998b9948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a86431-2203-4888-b3c6-29982a99d626', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f0de36-c201-41d8-b09d-d5dbf85615d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:40 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Volume volume-b5a86431-2203-4888-b3c6-29982a99d626 (b5a86431-2203-4888-b3c6-29982a99d626): created successfully Apr 22 09:22:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7f0de36-c201-41d8-b09d-d5dbf85615d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Flow 'volume_create_manager' (c9a74fc9-d07b-4bcf-a180-c48a99cee3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:40 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-a6be9b80-edc5-439c-9bb4-017d30984eca tempest-GroupSnapshotsTest-859463721 None] Created volume successfully. Apr 22 09:22:41 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] GroupSnapshot ff1a4448-4ce1-4a89-8d0e-3d5e92f8d7f2: creating. Apr 22 09:22:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] Group snapshot ff1a4448-4ce1-4a89-8d0e-3d5e92f8d7f2: creating. {{(pid=82642) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4209}} Apr 22 09:22:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] Creating offline snapshot f7156177-0ad9-4a16-a4d3-e9ad8952252b of volume b5a86431-2203-4888-b3c6-29982a99d626 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:22:41 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[362c6a07-c086-4854-abbc-cc7567c60c43]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:41 devstack sudo[85486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 Apr 22 09:22:41 devstack sudo[85486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:42 devstack sudo[85486]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626" returned: 0 in 1.140s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:42 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b 1G Apr 22 09:22:42 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:43 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b 1G" returned: 0 in 0.839s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a86431-2203-4888-b3c6-29982a99d626 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:43 devstack sudo[85515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a86431-2203-4888-b3c6-29982a99d626 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b Apr 22 09:22:43 devstack sudo[85515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:44 devstack sudo[85515]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b5a86431-2203-4888-b3c6-29982a99d626 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b" returned: 0 in 0.841s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:44 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:22:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:44 devstack sudo[85522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b Apr 22 09:22:44 devstack sudo[85522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:44 devstack sudo[85522]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b" returned: 0 in 0.498s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:44 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.info Apr 22 09:22:44 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:45 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-99e60f8c-e5b3-435a-8238-f003eeb5bf31 tempest-GroupsV314Test-824947546 None] Group tempest-GroupsV314Test-Group-1289719953: creating Apr 22 09:22:45 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-99e60f8c-e5b3-435a-8238-f003eeb5bf31 tempest-GroupsV314Test-824947546 None] Group tempest-GroupsV314Test-Group-1289719953: created successfully Apr 22 09:22:45 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-99e60f8c-e5b3-435a-8238-f003eeb5bf31 tempest-GroupsV314Test-824947546 None] Create group completed successfully. Apr 22 09:22:45 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.info" returned: 0 in 0.825s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:45 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:22:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:45 devstack sudo[85529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.info Apr 22 09:22:45 devstack sudo[85529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:46 devstack sudo[85529]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.info" returned: 0 in 0.453s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.663s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:46 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6b9e4d92-6f2e-47ca-80b7-3f515b02ebe3 tempest-GroupSnapshotsTest-859463721 None] group_snapshot ff1a4448-4ce1-4a89-8d0e-3d5e92f8d7f2: created successfully Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Flow 'volume_create_manager' (33c6fcc0-d8e8-4214-ac1c-398ce764c60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748d5a7f-00ba-4f89-bd22-81c502be70f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748d5a7f-00ba-4f89-bd22-81c502be70f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1013472393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49a96d04-c6bb-4d44-bcd0-df4618736dba,host='devstack@QuobyteHD#QuobyteHD',id=ab21d8b9-712b-4005-b624-6c2d861a6cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81f032c78e04aa58bcc0aca72a3d186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:47Z,use_quota=True,user_id='66a9460442fe45ae8c228a85018ec58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31a58e13-4ad2-42e0-b589-b38559f31bf0),volume_type_id=31a58e13-4ad2-42e0-b589-b38559f31bf0)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b3b00a-d4e7-44f0-93ca-71368bafb86c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b3b00a-d4e7-44f0-93ca-71368bafb86c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb17af3-4e3b-4af0-8cfc-e2e18aa4a8a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdb17af3-4e3b-4af0-8cfc-e2e18aa4a8a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab21d8b9-712b-4005-b624-6c2d861a6cc8', 'volume_name': 'volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc427a5-ff29-4724-b170-3ddabd50a602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bc427a5-ff29-4724-b170-3ddabd50a602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5392b55-fc7e-4c73-9cef-85866dfa2ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:47 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Volume ab21d8b9-712b-4005-b624-6c2d861a6cc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8', 'volume_size': 1} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=49a96d04-c6bb-4d44-bcd0-df4618736dba,created_at=2026-04-22T07:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1013472393',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=49a96d04-c6bb-4d44-bcd0-df4618736dba,host='devstack@QuobyteHD#QuobyteHD',id=ab21d8b9-712b-4005-b624-6c2d861a6cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c81f032c78e04aa58bcc0aca72a3d186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:22:47Z,use_quota=True,user_id='66a9460442fe45ae8c228a85018ec58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(31a58e13-4ad2-42e0-b589-b38559f31bf0),volume_type_id=31a58e13-4ad2-42e0-b589-b38559f31bf0)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Creating volume ab21d8b9-712b-4005-b624-6c2d861a6cc8 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:22:47 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:47 devstack sudo[85575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 1073741824 Apr 22 09:22:47 devstack sudo[85575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:47 devstack sudo[85575]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 1073741824" returned: 0 in 0.479s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:47 devstack sudo[85583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 Apr 22 09:22:47 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:48 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8" returned: 0 in 0.535s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.050s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.305s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-f7156177-0ad9-4a16-a4d3-e9ad8952252b-5b57d70f-898b-4635-922a-937cd317acc1" by "_create_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5392b55-fc7e-4c73-9cef-85866dfa2ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20c7895-07a4-4d22-ba1f-b58125c49078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-f7156177-0ad9-4a16-a4d3-e9ad8952252b-5b57d70f-898b-4635-922a-937cd317acc1" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Creating volume 5b57d70f-898b-4635-922a-937cd317acc1 from snapshot f7156177-0ad9-4a16-a4d3-e9ad8952252b {{(pid=82642) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-5b57d70f-898b-4635-922a-937cd317acc1" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:48 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Volume volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 (ab21d8b9-712b-4005-b624-6c2d861a6cc8): created successfully Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20c7895-07a4-4d22-ba1f-b58125c49078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Flow 'volume_create_manager' (33c6fcc0-d8e8-4214-ac1c-398ce764c60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-5b57d70f-898b-4635-922a-937cd317acc1" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] snapshot: f7156177-0ad9-4a16-a4d3-e9ad8952252b, volume: 5b57d70f-898b-4635-922a-937cd317acc1, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:22:48 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-026a9aa5-9a11-471c-a819-cd0d8a4c644d tempest-GroupsV314Test-824947546 None] Created volume successfully. Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[579d71bf-8066-4d2f-a03c-549a54be3d50]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:48 devstack sudo[85598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b Apr 22 09:22:48 devstack sudo[85598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:48 devstack sudo[85598]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b" returned: 0 in 0.682s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5a86431-2203-4888-b3c6-29982a99d626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed39d173-72c4-4c08-ada8-527f274ef59e]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:49 devstack sudo[85640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 Apr 22 09:22:49 devstack sudo[85640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:49 devstack sudo[85640]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626" returned: 0 in 0.630s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:49 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1 not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:22:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:49 devstack sudo[85654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1 Apr 22 09:22:49 devstack sudo[85654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Acquiring lock "cinder-56c3b068-b7ee-4289-8295-2b74d2a3bf8d-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Lock "cinder-56c3b068-b7ee-4289-8295-2b74d2a3bf8d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Acquiring lock "cinder-quobyte-56c3b068-b7ee-4289-8295-2b74d2a3bf8d" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Lock "cinder-quobyte-56c3b068-b7ee-4289-8295-2b74d2a3bf8d" acquired by "delete_volume" :: waited 0.021s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:53 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[65627ff2-d8b8-430e-97fe-fd4637cd84c1]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:54 devstack sudo[85725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d Apr 22 09:22:54 devstack sudo[85725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:55 devstack sudo[85654]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1" returned: 0 in 5.597s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:55 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7a5117-884d-48b3-a2cd-b6917dd28e9b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:55 devstack sudo[85729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 Apr 22 09:22:55 devstack sudo[85729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:55 devstack sudo[85725]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d" returned: 0 in 1.860s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:55 devstack sudo[85734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d Apr 22 09:22:55 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:56 devstack sudo[85729]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626" returned: 0 in 1.039s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626, size 1024.00 MB, duration 5.60 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1 {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:22:56 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Converted 1024.00 MB image at 182.91 MB/s Apr 22 09:22:56 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:56 devstack sudo[85739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1 Apr 22 09:22:56 devstack sudo[85739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:56 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56c3b068-b7ee-4289-8295-2b74d2a3bf8d" returned: 0 in 0.842s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Lock "cinder-quobyte-56c3b068-b7ee-4289-8295-2b74d2a3bf8d" released by "delete_volume" :: held 2.800s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Created reservations ['fa834f20-b6a5-492f-9bba-069ba3785495', '33a2e614-df48-4882-8c6e-3998773d4307', '38721d69-8850-4555-8d5c-81be88661d40', '895c52c1-e918-4905-96a3-aeae3e033c5e'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:56 devstack sudo[85743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:22:56 devstack sudo[85743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:56 devstack sudo[85739]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1" returned: 0 in 0.671s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-5b57d70f-898b-4635-922a-937cd317acc1" released by "_copy_volume_from_snapshot" :: held 8.744s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-f7156177-0ad9-4a16-a4d3-e9ad8952252b-5b57d70f-898b-4635-922a-937cd317acc1" released by "_create_volume_from_snapshot" :: held 8.806s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.833s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:22:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.755s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:22:56 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Cloning volume ab21d8b9-712b-4005-b624-6c2d861a6cc8 to volume 37331544-5cf9-4d80-b1f8-32bbc477655e Apr 22 09:22:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Creating offline snapshot 4327d5ad-7da1-4d82-a019-4ed10c47f8bc of volume ab21d8b9-712b-4005-b624-6c2d861a6cc8 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:22:57 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e093d5-8fac-41c9-90c0-6f3282751fce]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:57 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f01b9544-ff51-4ac7-af99-e951fd30fb3f tempest-GroupSnapshotsTest-859463721 None] Create group from source-snapshot-ff1a4448-4ce1-4a89-8d0e-3d5e92f8d7f2 completed successfully. Apr 22 09:22:57 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 Apr 22 09:22:57 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:57 devstack sudo[85743]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.812s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:57 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:22:57 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Deleted volume successfully. Apr 22 09:22:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6fbd5497-0168-4759-955a-7e1f46542ab8 tempest-ServerRescueNegativeTestJSON-999136373 None] Lock "cinder-56c3b068-b7ee-4289-8295-2b74d2a3bf8d-delete_volume" released by "delete_volume" :: held 3.853s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:22:57 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8" returned: 0 in 0.877s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:57 devstack sudo[85754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc 1G Apr 22 09:22:57 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-5b57d70f-898b-4635-922a-937cd317acc1" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:22:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-5b57d70f-898b-4635-922a-937cd317acc1" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:22:58 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[95c50c4d-0080-4ad0-8a79-819e769994d5]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:22:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:58 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc 1G" returned: 0 in 0.761s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:58 devstack sudo[85769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc Apr 22 09:22:58 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:58 devstack sudo[85765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1 Apr 22 09:22:58 devstack sudo[85765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:59 devstack sudo[85765]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1" returned: 0 in 1.025s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:59 devstack sudo[85799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1 Apr 22 09:22:59 devstack sudo[85799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:22:59 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root Apr 22 09:22:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc" returned: 0 in 1.085s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:22:59 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:22:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:22:59 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc Apr 22 09:22:59 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:00 devstack sudo[85799]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5b57d70f-898b-4635-922a-937cd317acc1" returned: 0 in 0.631s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-5b57d70f-898b-4635-922a-937cd317acc1" released by "delete_volume" :: held 1.704s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Created reservations ['6fb6cd49-0cd1-4796-af27-11494f13ccaa'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:00 devstack cinder-volume[82642]: WARNING cinder.quota [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1223373339 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1223373339, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:23:00 devstack cinder-volume[82642]: WARNING cinder.quota [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1223373339 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1223373339, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Created reservations ['3e057e7a-4908-46d2-8b55-359f4c212231', 'c962bd4a-1b52-460d-be0a-c4cfd94f9d68', 'ef767605-f19e-4220-840e-4f473c5b3451', '35d7463a-bc6a-4e99-a785-c23946d3cb7b'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:00 devstack sudo[85825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:23:00 devstack sudo[85825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:00 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc" returned: 0 in 0.834s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:00 devstack sudo[85830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.info Apr 22 09:23:00 devstack sudo[85830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:01 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] group_snapshot ff1a4448-4ce1-4a89-8d0e-3d5e92f8d7f2: deleting Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] group_snapshot ff1a4448-4ce1-4a89-8d0e-3d5e92f8d7f2: deleting {{(pid=82642) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4384}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-b5a86431-2203-4888-b3c6-29982a99d626" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-b5a86431-2203-4888-b3c6-29982a99d626" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-f7156177-0ad9-4a16-a4d3-e9ad8952252b" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-f7156177-0ad9-4a16-a4d3-e9ad8952252b" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Deleting offline snapshot f7156177-0ad9-4a16-a4d3-e9ad8952252b of volume b5a86431-2203-4888-b3c6-29982a99d626 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] snapshot_file for this snap is: volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4881762f-5a9b-4ae4-b44c-4ab6f91cfdc1]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:01 devstack sudo[85825]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 1.008s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:23:01 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d93ba42e-380f-4adb-bdf4-840935832479 tempest-GroupSnapshotsTest-859463721 None] Delete group completed successfully. Apr 22 09:23:01 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b Apr 22 09:23:01 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:01 devstack sudo[85830]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.info" returned: 0 in 1.026s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:01 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:01 devstack sudo[85848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.info Apr 22 09:23:01 devstack sudo[85848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:01 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b" returned: 0 in 0.621s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b5a86431-2203-4888-b3c6-29982a99d626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[277fe3a1-8466-481a-946f-eb3361a6d219]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:02 devstack sudo[85853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 Apr 22 09:23:02 devstack sudo[85853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:02 devstack sudo[85848]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.info" returned: 0 in 0.511s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Acquiring lock "cinder-quobyte-37331544-5cf9-4d80-b1f8-32bbc477655e" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Lock "cinder-quobyte-37331544-5cf9-4d80-b1f8-32bbc477655e" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] snapshot: 4327d5ad-7da1-4d82-a019-4ed10c47f8bc, volume: 37331544-5cf9-4d80-b1f8-32bbc477655e, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6420ac3-d305-4828-b0e5-dfb78401fb81]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:02 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc Apr 22 09:23:02 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:02 devstack sudo[85853]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626" returned: 0 in 0.762s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:02 devstack sudo[85861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b Apr 22 09:23:02 devstack sudo[85861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:03 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc" returned: 0 in 0.771s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:23:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:23:03 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bba78b8-f95d-40df-ae99-2f544f8779bb]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:03 devstack sudo[85866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 Apr 22 09:23:03 devstack sudo[85866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:03 devstack sudo[85861]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b" returned: 0 in 1.156s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:03 devstack sudo[85876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b Apr 22 09:23:03 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:04 devstack sudo[85866]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8" returned: 0 in 0.937s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:04 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:23:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:04 devstack sudo[85878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e Apr 22 09:23:04 devstack sudo[85878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:04 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626.f7156177-0ad9-4a16-a4d3-e9ad8952252b" returned: 0 in 0.519s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-f7156177-0ad9-4a16-a4d3-e9ad8952252b" released by "_delete_snapshot" :: held 3.228s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-b5a86431-2203-4888-b3c6-29982a99d626" released by "delete_snapshot" :: held 3.250s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:04 devstack cinder-volume[82642]: WARNING cinder.quota [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1223373339 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1223373339, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:23:04 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] Created reservations ['5b142984-294c-4586-aeee-f08a6c0f44ca', 'ba92d586-3160-451b-a444-5d7d77217cba', 'aba09724-7487-4bfd-8f93-a6131c8b7f62', '7d2d31b1-ec46-4c0a-a025-85969e5d39f5'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:04 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-13c1b8ff-6519-47ea-a8ce-2f4cc06038f9 tempest-GroupSnapshotsTest-859463721 None] group_snapshot ff1a4448-4ce1-4a89-8d0e-3d5e92f8d7f2: deleted successfully Apr 22 09:23:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-b5a86431-2203-4888-b3c6-29982a99d626" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-b5a86431-2203-4888-b3c6-29982a99d626" acquired by "delete_volume" :: waited 0.097s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:06 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b93d5b-1c8b-4265-b647-2d64b848abce]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:06 devstack sudo[85892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 Apr 22 09:23:06 devstack sudo[85892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:08 devstack sudo[85878]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e" returned: 0 in 4.048s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:08 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e274057e-4ffb-4eed-b49a-25aad087a39b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:08 devstack sudo[85922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 Apr 22 09:23:08 devstack sudo[85922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:08 devstack sudo[85892]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626" returned: 0 in 1.512s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:08 devstack sudo[85924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626 Apr 22 09:23:08 devstack sudo[85924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:08 devstack sudo[85924]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b5a86431-2203-4888-b3c6-29982a99d626" returned: 0 in 0.681s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-b5a86431-2203-4888-b3c6-29982a99d626" released by "delete_volume" :: held 2.317s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Created reservations ['7cb103e5-0ee2-4546-bf48-f6ac1bb6f8c5'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:09 devstack cinder-volume[82642]: WARNING cinder.db.sqlalchemy.api [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1223373339'] Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Created reservations ['c6b1cd4c-f3f6-400a-a29b-0302a2b6eb37', 'a00c083f-6c62-4c01-92ea-e994f126fbc9', '7ef3eb18-c8d8-4725-8daa-41cc28d20612', '7c273c94-5d95-48d1-814e-e4b1dfc9b985'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:09 devstack sudo[85922]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8" returned: 0 in 1.032s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8, size 1024.00 MB, duration 4.05 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:23:09 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Converted 1024.00 MB image at 252.81 MB/s Apr 22 09:23:09 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:09 devstack sudo[85938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e Apr 22 09:23:09 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:09 devstack sudo[85941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:23:09 devstack sudo[85941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:09 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e" returned: 0 in 0.503s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Lock "cinder-quobyte-37331544-5cf9-4d80-b1f8-32bbc477655e" released by "_copy_volume_from_snapshot" :: held 7.409s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Acquiring lock "cinder-quobyte-4327d5ad-7da1-4d82-a019-4ed10c47f8bc" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Lock "cinder-quobyte-4327d5ad-7da1-4d82-a019-4ed10c47f8bc" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Deleting offline snapshot 4327d5ad-7da1-4d82-a019-4ed10c47f8bc of volume ab21d8b9-712b-4005-b624-6c2d861a6cc8 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] snapshot_file for this snap is: volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7555942f-84db-4228-984d-715cdd136dfc]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:09 devstack sudo[85946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc Apr 22 09:23:09 devstack sudo[85946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:09 devstack sudo[85941]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.581s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:09 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:23:09 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-224b4f91-d8bc-4fb4-ad06-b7b475d8e8fa tempest-GroupSnapshotsTest-859463721 None] Delete group completed successfully. Apr 22 09:23:10 devstack sudo[85946]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc" returned: 0 in 0.648s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:10 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3a17b0-004c-47c3-8842-b0bd448b67e1]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:10 devstack sudo[85955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 Apr 22 09:23:10 devstack sudo[85955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:10 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ade0167d-5d28-4245-9fa7-1932673ded94 tempest-GroupSnapshotsTest-859463721 None] Group tempest-GroupSnapshotsTest-Group-2126957754: creating Apr 22 09:23:10 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ade0167d-5d28-4245-9fa7-1932673ded94 tempest-GroupSnapshotsTest-859463721 None] Group tempest-GroupSnapshotsTest-Group-2126957754: created successfully Apr 22 09:23:10 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ade0167d-5d28-4245-9fa7-1932673ded94 tempest-GroupSnapshotsTest-859463721 None] Create group completed successfully. Apr 22 09:23:10 devstack sudo[85955]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8" returned: 0 in 0.564s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:10 devstack sudo[85962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc Apr 22 09:23:10 devstack sudo[85962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:11 devstack sudo[85962]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc" returned: 0 in 0.507s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:11 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc Apr 22 09:23:11 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:11 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8.4327d5ad-7da1-4d82-a019-4ed10c47f8bc" returned: 0 in 0.445s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Lock "cinder-quobyte-4327d5ad-7da1-4d82-a019-4ed10c47f8bc" released by "_delete_snapshot" :: held 2.222s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.992s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:11 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:23:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Flow 'volume_create_manager' (c133d1a4-f385-4143-a7f0-f37f3849174e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:23:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860b8162-c0ea-4e5f-8b66-e58cabc7a5f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860b8162-c0ea-4e5f-8b66-e58cabc7a5f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1750933527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6131f989-84b4-4dc3-bb83-3382deebc375,host='devstack@QuobyteHD#QuobyteHD',id=0215edf0-57f2-41fe-b9fd-1a97d789a81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11700ff62a149bc852fe3aaaa140e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:23:12Z,use_quota=True,user_id='6e6b03f4807f4ac7aefd189227dfa60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(264d316b-5282-4414-a72d-b2a895e6e59a),volume_type_id=264d316b-5282-4414-a72d-b2a895e6e59a)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf384be-8c8a-4ef7-b1a8-d540c26b3a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf384be-8c8a-4ef7-b1a8-d540c26b3a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fe7af3-329f-4312-8d16-291f30365d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14fe7af3-329f-4312-8d16-291f30365d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0215edf0-57f2-41fe-b9fd-1a97d789a81f', 'volume_name': 'volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca071b1-a4d2-4248-9554-dce8bde286be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cca071b1-a4d2-4248-9554-dce8bde286be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1df4eb6-d9ca-40c2-9636-90f65a2da57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:12 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Volume 0215edf0-57f2-41fe-b9fd-1a97d789a81f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f', 'volume_size': 1} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6131f989-84b4-4dc3-bb83-3382deebc375,created_at=2026-04-22T07:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1750933527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6131f989-84b4-4dc3-bb83-3382deebc375,host='devstack@QuobyteHD#QuobyteHD',id=0215edf0-57f2-41fe-b9fd-1a97d789a81f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11700ff62a149bc852fe3aaaa140e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:23:12Z,use_quota=True,user_id='6e6b03f4807f4ac7aefd189227dfa60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(264d316b-5282-4414-a72d-b2a895e6e59a),volume_type_id=264d316b-5282-4414-a72d-b2a895e6e59a)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Creating volume 0215edf0-57f2-41fe-b9fd-1a97d789a81f {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:23:12 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:12 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f 1073741824 Apr 22 09:23:12 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:12 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-9d7f826e-ad2e-48d3-9853-d0cf32e40c21 tempest-GroupsV314Test-824947546 None] Create group from source-group-49a96d04-c6bb-4d44-bcd0-df4618736dba completed successfully. Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Acquiring lock "cinder-quobyte-37331544-5cf9-4d80-b1f8-32bbc477655e" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Lock "cinder-quobyte-37331544-5cf9-4d80-b1f8-32bbc477655e" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b874a7-00cb-4ac0-be34-16a3312c5d8a]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:12 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e Apr 22 09:23:12 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:12 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f 1073741824" returned: 0 in 0.581s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:12 devstack sudo[85978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f Apr 22 09:23:12 devstack sudo[85978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:12 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e" returned: 0 in 0.597s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:12 devstack sudo[85983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e Apr 22 09:23:12 devstack sudo[85983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:13 devstack sudo[85978]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f" returned: 0 in 0.621s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1df4eb6-d9ca-40c2-9636-90f65a2da57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd8f944-cbb7-46be-8ad3-da9bcb9bce1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:13 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Volume volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f (0215edf0-57f2-41fe-b9fd-1a97d789a81f): created successfully Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd8f944-cbb7-46be-8ad3-da9bcb9bce1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Flow 'volume_create_manager' (c133d1a4-f385-4143-a7f0-f37f3849174e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:23:13 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b6309bdd-da9a-4707-8689-aac1e52043d6 tempest-GroupSnapshotsTest-859463721 None] Created volume successfully. Apr 22 09:23:13 devstack sudo[85983]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-37331544-5cf9-4d80-b1f8-32bbc477655e" returned: 0 in 0.530s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Lock "cinder-quobyte-37331544-5cf9-4d80-b1f8-32bbc477655e" released by "delete_volume" :: held 1.163s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Created reservations ['fb8eba18-a4b6-4e00-aaed-bbce5e77bcf4'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:13 devstack cinder-volume[82642]: WARNING cinder.quota [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1071791866 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1071791866, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:23:13 devstack cinder-volume[82642]: WARNING cinder.quota [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1071791866 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1071791866, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Created reservations ['decad9c4-3f34-42df-a34f-526ed4bcb7a6', '61584cd0-cae1-4c52-beb0-47b589b50ca5', '47ea4a1c-b1f4-4b85-98d8-490c230ecdc5', 'c1a24fe3-ffea-4876-a1ef-fd4734158d70'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:13 devstack sudo[85987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:23:13 devstack sudo[85987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:14 devstack sudo[85987]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.534s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:23:14 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e9f717d4-4dd0-4209-aa39-7f22678852af tempest-GroupsV314Test-824947546 None] Delete group completed successfully. Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Flow 'volume_create_manager' (ebb54c9f-ad86-4eb3-80ad-8a63169fe3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e690b50-96d7-4559-a7ce-e7a097a8cfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e690b50-96d7-4559-a7ce-e7a097a8cfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886277942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6131f989-84b4-4dc3-bb83-3382deebc375,host='devstack@QuobyteHD#QuobyteHD',id=e17bb45c-72fe-4564-b37f-687659bc0e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11700ff62a149bc852fe3aaaa140e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:23:15Z,use_quota=True,user_id='6e6b03f4807f4ac7aefd189227dfa60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(264d316b-5282-4414-a72d-b2a895e6e59a),volume_type_id=264d316b-5282-4414-a72d-b2a895e6e59a)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e22c18-9a0e-4c28-9057-1ea991c68180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e22c18-9a0e-4c28-9057-1ea991c68180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7f85da-20bc-4f72-a014-746bec81ec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c7f85da-20bc-4f72-a014-746bec81ec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17bb45c-72fe-4564-b37f-687659bc0e22', 'volume_name': 'volume-e17bb45c-72fe-4564-b37f-687659bc0e22', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad13187c-7f06-42d1-9ad6-00fba6e1a3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad13187c-7f06-42d1-9ad6-00fba6e1a3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1fa9f5-1990-4332-89a5-bf812e9cd799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:14 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Volume e17bb45c-72fe-4564-b37f-687659bc0e22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17bb45c-72fe-4564-b37f-687659bc0e22', 'volume_size': 1} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6131f989-84b4-4dc3-bb83-3382deebc375,created_at=2026-04-22T07:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-886277942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6131f989-84b4-4dc3-bb83-3382deebc375,host='devstack@QuobyteHD#QuobyteHD',id=e17bb45c-72fe-4564-b37f-687659bc0e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11700ff62a149bc852fe3aaaa140e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:23:15Z,use_quota=True,user_id='6e6b03f4807f4ac7aefd189227dfa60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(264d316b-5282-4414-a72d-b2a895e6e59a),volume_type_id=264d316b-5282-4414-a72d-b2a895e6e59a)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Creating volume e17bb45c-72fe-4564-b37f-687659bc0e22 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:23:14 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:23:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:14 devstack sudo[85992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 1073741824 Apr 22 09:23:14 devstack sudo[85992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Acquiring lock "cinder-quobyte-ab21d8b9-712b-4005-b624-6c2d861a6cc8" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Lock "cinder-quobyte-ab21d8b9-712b-4005-b624-6c2d861a6cc8" acquired by "delete_volume" :: waited 0.032s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6485847-037d-4119-a307-8c2ace609b8f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:15 devstack sudo[85995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 Apr 22 09:23:15 devstack sudo[85995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Flow 'volume_create_manager' (bbbb916b-228e-4ca0-a46d-5e1bb51900fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c8413b-0482-47f2-ad7b-15f736fbbb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96c8413b-0482-47f2-ad7b-15f736fbbb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:23:15Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1200b6cd-dbdc-4842-9dd3-d4a89715877f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddce9a03101f44849a16972e1d90a767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:23:15Z,use_quota=True,user_id='97f09d8e55304c0ebb39d8fbd1bfb73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac710435-182b-4828-a196-e1f8eb35c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac710435-182b-4828-a196-e1f8eb35c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a1ded6-7b26-4a4e-8721-f95c5f4471cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG cinder.image.glance [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Creating Keystone auth plugin from conf {{(pid=82642) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 09:23:15 devstack sudo[85992]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 1073741824" returned: 0 in 1.078s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:15 devstack sudo[86003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 Apr 22 09:23:15 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:15 devstack sudo[85995]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8" returned: 0 in 0.819s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:15 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8 Apr 22 09:23:15 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a1ded6-7b26-4a4e-8721-f95c5f4471cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1200b6cd-dbdc-4842-9dd3-d4a89715877f', 'volume_name': 'volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b939d87b-7d38-478c-8906-8413ad27d0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b939d87b-7d38-478c-8906-8413ad27d0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3717efd-b668-4b71-8770-fe9b4f7ef0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:16 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Volume 1200b6cd-dbdc-4842-9dd3-d4a89715877f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Trying to clone 1200b6cd-dbdc-4842-9dd3-d4a89715877f from image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]). {{(pid=82642) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:736}} Apr 22 09:23:16 devstack cinder-volume[82642]: INFO cinder.image.image_utils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Image download 20.69 MB at 20.69 MB/s Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e731c7a5-0cc0-4cd1-a54c-7f2936e89384]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:16 devstack sudo[86028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD Apr 22 09:23:16 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:16 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ab21d8b9-712b-4005-b624-6c2d861a6cc8" returned: 0 in 0.580s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Lock "cinder-quobyte-ab21d8b9-712b-4005-b624-6c2d861a6cc8" released by "delete_volume" :: held 1.445s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Created reservations ['b53207f7-ef58-45f6-ad81-99d79bf084f8'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Created reservations ['09b9e90c-d583-4f3c-9c99-a82d581c3162', 'bb74cd25-fb52-4b4a-83fb-8fba45503908', '689e2aac-79da-4373-bbac-72875b23a643', 'f537debc-2a66-4f99-ba8f-08aa71b0037a'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:16 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22" returned: 0 in 0.883s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] <== create_volume: return (2018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff1fa9f5-1990-4332-89a5-bf812e9cd799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17bb45c-72fe-4564-b37f-687659bc0e22', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01573131-5581-4540-9990-1195c29139c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:16 devstack sudo[86033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:23:16 devstack sudo[86033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:16 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Volume volume-e17bb45c-72fe-4564-b37f-687659bc0e22 (e17bb45c-72fe-4564-b37f-687659bc0e22): created successfully Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01573131-5581-4540-9990-1195c29139c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Flow 'volume_create_manager' (ebb54c9f-ad86-4eb3-80ad-8a63169fe3ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:23:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-bf77403a-82ab-40c2-9ed5-5be04edd7114 tempest-GroupSnapshotsTest-859463721 None] Created volume successfully. Apr 22 09:23:17 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD" returned: 0 in 0.715s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Temporary image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b is fetched for user 97f09d8e55304c0ebb39d8fbd1bfb73c. {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:1439}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb15b59a-cc6c-4d3a-b001-fa599df77fd5]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7dd0988f-41b0-4e9d-834f-80540de94b7d tempest-GroupSnapshotsTest-859463721 None] Update group completed successfully. Apr 22 09:23:17 devstack sudo[86038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD Apr 22 09:23:17 devstack sudo[86038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:17 devstack sudo[86033]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.910s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:23:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e4bb3a44-ae2a-48af-bf54-e718bcbb0ddd tempest-GroupsV314Test-824947546 None] Delete group completed successfully. Apr 22 09:23:17 devstack sudo[86038]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:23:15Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1200b6cd-dbdc-4842-9dd3-d4a89715877f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddce9a03101f44849a16972e1d90a767',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:23:15Z,use_quota=True,user_id='97f09d8e55304c0ebb39d8fbd1bfb73c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Creating volume 1200b6cd-dbdc-4842-9dd3-d4a89715877f {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:23:17 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:23:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:17 devstack sudo[86045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f 1073741824 Apr 22 09:23:17 devstack sudo[86045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:18 devstack sudo[86045]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:18 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-2d9a00f5-03a9-4114-b0e1-d874a85dfe09 tempest-GroupSnapshotsTest-859463721 None] Update group completed successfully. Apr 22 09:23:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f 1073741824" returned: 0 in 0.657s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:18 devstack sudo[86053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f Apr 22 09:23:18 devstack sudo[86053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:19 devstack sudo[86053]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f" returned: 0 in 0.582s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:23:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:19 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Attempting download of 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b ((None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}])) to volume 1200b6cd-dbdc-4842-9dd3-d4a89715877f. {{(pid=82642) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 22 09:23:19 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9e1b91-3cee-4294-87db-d341634ff780]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_ez109r1v {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:19 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_ez109r1v Apr 22 09:23:19 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:19 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d10d5cb2-46a7-4691-a9e8-0eef8ace1cbb tempest-GroupSnapshotsTest-859463721 None] Update group completed successfully. Apr 22 09:23:19 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_ez109r1v" returned: 0 in 0.709s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_ez109r1v {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:19 devstack sudo[86085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_ez109r1v Apr 22 09:23:19 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:20 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_ez109r1v" returned: 1 in 0.567s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_ez109r1v' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:23:20 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[de52e3ef-ff9b-4d47-a5b7-20ef2a15c46b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:20 devstack sudo[86089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD Apr 22 09:23:20 devstack sudo[86089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:20 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-77f92f28-56da-4073-b46b-04b0b626354b tempest-GroupSnapshotsTest-859463721 None] Update group completed successfully. Apr 22 09:23:21 devstack sudo[86089]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD" returned: 0 in 0.574s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:21 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b was qcow2, converting to raw {{(pid=82642) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1126}} Apr 22 09:23:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:21 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f Apr 22 09:23:21 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:22 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] GroupSnapshot 789f5db0-fc8f-42ce-89fd-b9d6b304ab82: creating. Apr 22 09:23:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Group snapshot 789f5db0-fc8f-42ce-89fd-b9d6b304ab82: creating. {{(pid=82642) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4209}} Apr 22 09:23:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Creating offline snapshot c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 of volume 0215edf0-57f2-41fe-b9fd-1a97d789a81f {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:23:22 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f" returned: 0 in 1.325s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:22 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_6ilof7xkdevstack@QuobyteHD, size 112.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:23:22 devstack cinder-volume[82642]: INFO cinder.image.image_utils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Converted 112.00 MB image at 84.40 MB/s Apr 22 09:23:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:22 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7488db16-673a-45b8-b2e6-e323656426a2]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:22 devstack sudo[86112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f 1G Apr 22 09:23:22 devstack sudo[86112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:22 devstack sudo[86113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f Apr 22 09:23:22 devstack sudo[86113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:23 devstack sudo[86112]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f 1G" returned: 0 in 0.759s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:23 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[565bf9c8-2bb9-4481-936d-ba83e546f3d1]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:23 devstack sudo[86113]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f" returned: 0 in 0.916s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:23 devstack sudo[86123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 1G Apr 22 09:23:23 devstack sudo[86123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:23 devstack sudo[86119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f Apr 22 09:23:23 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:23 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f" returned: 0 in 0.634s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:23 devstack sudo[86129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f Apr 22 09:23:23 devstack sudo[86129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:24 devstack sudo[86123]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 1G" returned: 0 in 0.722s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:24 devstack sudo[86133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 Apr 22 09:23:24 devstack sudo[86133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:24 devstack sudo[86129]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f" returned: 1 in 0.778s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Downloaded image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b ((None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}])) to volume 1200b6cd-dbdc-4842-9dd3-d4a89715877f successfully. {{(pid=82642) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Temporary image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b for user 97f09d8e55304c0ebb39d8fbd1bfb73c is deleted. {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:1443}} Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Marking volume 1200b6cd-dbdc-4842-9dd3-d4a89715877f as bootable. {{(pid=82642) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Copying metadata from image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b to 1200b6cd-dbdc-4842-9dd3-d4a89715877f. {{(pid=82642) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Creating volume glance metadata for volume 1200b6cd-dbdc-4842-9dd3-d4a89715877f backed by image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82642) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3717efd-b668-4b71-8770-fe9b4f7ef0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e9ba5a-ae4c-4692-a134-de806e6fd9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:24 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Volume volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f (1200b6cd-dbdc-4842-9dd3-d4a89715877f): created successfully Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27e9ba5a-ae4c-4692-a134-de806e6fd9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Flow 'volume_create_manager' (bbbb916b-228e-4ca0-a46d-5e1bb51900fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:23:24 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-74171c96-de48-450c-992c-23373b422630 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Created volume successfully. Apr 22 09:23:24 devstack sudo[86133]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574" returned: 0 in 0.893s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:24 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:23:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:24 devstack sudo[86141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 Apr 22 09:23:24 devstack sudo[86141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:25 devstack sudo[86141]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574" returned: 0 in 0.478s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:25 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.info Apr 22 09:23:25 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:26 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.info" returned: 0 in 0.932s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:26 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:23:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:26 devstack sudo[86147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.info Apr 22 09:23:26 devstack sudo[86147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:27 devstack sudo[86147]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.info" returned: 0 in 0.647s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.673s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Creating offline snapshot d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca of volume e17bb45c-72fe-4564-b37f-687659bc0e22 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bd2862-0100-4d6b-9224-a63d59f6a842]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:27 devstack sudo[86150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 Apr 22 09:23:27 devstack sudo[86150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Flow 'volume_create_manager' (f79f44df-763f-4685-b3f4-b7124519677d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d6805e-1912-4386-a734-4b99c118e7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4d6805e-1912-4386-a734-4b99c118e7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2033460619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c672747-d7cc-4118-80c8-18f4628d167e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587c035d9448437aa51414ee4e1a3496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:23:27Z,use_quota=True,user_id='ac1017ca044844fca8d06aba6a7ed1fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c41ff7-a27d-4e90-ab28-ea677156968f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c41ff7-a27d-4e90-ab28-ea677156968f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7cbea1-4be4-49b1-9ee1-f89875c906db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7cbea1-4be4-49b1-9ee1-f89875c906db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c672747-d7cc-4118-80c8-18f4628d167e', 'volume_name': 'volume-8c672747-d7cc-4118-80c8-18f4628d167e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde16419-b47b-492b-b6c1-826679a3ddc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde16419-b47b-492b-b6c1-826679a3ddc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60d5d7d-3007-487d-b8d2-e789347a49f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:27 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Volume 8c672747-d7cc-4118-80c8-18f4628d167e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c672747-d7cc-4118-80c8-18f4628d167e', 'volume_size': 1} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:27 devstack sudo[86150]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22" returned: 0 in 0.849s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:27 devstack sudo[86155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca 1G Apr 22 09:23:27 devstack sudo[86155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-7b1bc2ef-9cce-4d97-9339-a7e654ce9759 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:28 devstack sudo[86155]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca 1G" returned: 0 in 0.562s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e17bb45c-72fe-4564-b37f-687659bc0e22 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:28 devstack sudo[86168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e17bb45c-72fe-4564-b37f-687659bc0e22 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca Apr 22 09:23:28 devstack sudo[86168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:28 devstack sudo[86168]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e17bb45c-72fe-4564-b37f-687659bc0e22 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca" returned: 0 in 0.485s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:28 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:23:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:28 devstack sudo[86173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca Apr 22 09:23:28 devstack sudo[86173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:29 devstack sudo[86173]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca" returned: 0 in 0.456s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:29 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:UPDATE=103,cinder:DELETE=5,cinder:SELECT=123,cinder:INSERT=35 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:23:29 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=112,cinder:UPDATE=111,cinder:INSERT=24,cinder:DELETE=2 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:23:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:29 devstack sudo[86176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.info Apr 22 09:23:29 devstack sudo[86176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:29 devstack sudo[86176]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.info" returned: 0 in 0.480s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:29 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:23:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:29 devstack sudo[86179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.info Apr 22 09:23:29 devstack sudo[86179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:30 devstack sudo[86179]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.info" returned: 0 in 0.428s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.361s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.979s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2033460619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c672747-d7cc-4118-80c8-18f4628d167e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='587c035d9448437aa51414ee4e1a3496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:23:27Z,use_quota=True,user_id='ac1017ca044844fca8d06aba6a7ed1fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Creating volume 8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:23:30 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:30 devstack sudo[86185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e 1073741824 Apr 22 09:23:30 devstack sudo[86185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:30 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-dbd1155c-417f-4c03-9694-d414fee547ce tempest-GroupSnapshotsTest-859463721 None] group_snapshot 789f5db0-fc8f-42ce-89fd-b9d6b304ab82: created successfully Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_service.periodic_task [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:30 devstack sudo[86188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:23:30 devstack sudo[86188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:30 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] group_snapshot 789f5db0-fc8f-42ce-89fd-b9d6b304ab82: deleting Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] group_snapshot 789f5db0-fc8f-42ce-89fd-b9d6b304ab82: deleting {{(pid=82642) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4384}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-0215edf0-57f2-41fe-b9fd-1a97d789a81f" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-0215edf0-57f2-41fe-b9fd-1a97d789a81f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Deleting offline snapshot c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 of volume 0215edf0-57f2-41fe-b9fd-1a97d789a81f {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] snapshot_file for this snap is: volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fe4e26-3f44-4927-afe1-50d93be2eaeb]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:30 devstack sudo[86192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 Apr 22 09:23:30 devstack sudo[86192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:31 devstack sudo[86185]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e 1073741824" returned: 0 in 0.680s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:31 devstack sudo[86197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e Apr 22 09:23:31 devstack sudo[86197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:31 devstack sudo[86188]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.575s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:23:31 devstack sudo[86192]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574" returned: 0 in 0.576s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6cd039-4054-463c-8150-7bd3ffa1dbcf]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:31 devstack sudo[86203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f Apr 22 09:23:31 devstack sudo[86203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:31 devstack sudo[86197]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e" returned: 0 in 0.459s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-7b1bc2ef-9cce-4d97-9339-a7e654ce9759 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.508s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b60d5d7d-3007-487d-b8d2-e789347a49f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c672747-d7cc-4118-80c8-18f4628d167e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9057f3c6-8eff-44f2-8816-0a8d465da49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30b4280-6b27-4cdb-9f3f-3c879da7becd]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-7b1bc2ef-9cce-4d97-9339-a7e654ce9759 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:31 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Volume volume-8c672747-d7cc-4118-80c8-18f4628d167e (8c672747-d7cc-4118-80c8-18f4628d167e): created successfully Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9057f3c6-8eff-44f2-8816-0a8d465da49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Flow 'volume_create_manager' (f79f44df-763f-4685-b3f4-b7124519677d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:23:31 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6e321690-b17c-4e37-b476-d415017c56a6 tempest-SnapshotsActionsTest-402326745 None] Created volume successfully. Apr 22 09:23:31 devstack sudo[86206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f Apr 22 09:23:31 devstack sudo[86206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:31 devstack sudo[86203]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f" returned: 0 in 0.495s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:31 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 Apr 22 09:23:31 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:32 devstack sudo[86206]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-7b1bc2ef-9cce-4d97-9339-a7e654ce9759 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f" returned: 0 in 0.526s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-7b1bc2ef-9cce-4d97-9339-a7e654ce9759 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:32 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f Apr 22 09:23:32 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:32 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574" returned: 0 in 0.524s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:32 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574 Apr 22 09:23:32 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:32 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-7b1bc2ef-9cce-4d97-9339-a7e654ce9759 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f" returned: 1 in 0.561s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-7b1bc2ef-9cce-4d97-9339-a7e654ce9759 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-7b1bc2ef-9cce-4d97-9339-a7e654ce9759 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.124s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-7b1bc2ef-9cce-4d97-9339-a7e654ce9759 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38', 'name': 'volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '70bed6ff-76f5-44db-bef0-79af17e47101', 'enforce_multipath': True} {{(pid=82642) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4958}} Apr 22 09:23:32 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-7388896c-33cb-4d4d-afda-8e58d405d7c3 req-7b1bc2ef-9cce-4d97-9339-a7e654ce9759 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] attachment_update completed successfully. Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] Creating offline snapshot 5401eaf9-88c3-459f-8ff7-ac3cdc111a8d of volume 8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d032c2-6ba9-4a91-91f2-5000a6158d9a]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:32 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e Apr 22 09:23:32 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:32 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f.c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574" returned: 0 in 0.467s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-c95ef1c2-da5d-4e6b-ab4d-8dcf2d564574" released by "_delete_snapshot" :: held 2.118s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-0215edf0-57f2-41fe-b9fd-1a97d789a81f" released by "delete_snapshot" :: held 2.129s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-e17bb45c-72fe-4564-b37f-687659bc0e22" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-e17bb45c-72fe-4564-b37f-687659bc0e22" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Deleting offline snapshot d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca of volume e17bb45c-72fe-4564-b37f-687659bc0e22 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] snapshot_file for this snap is: volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[46759b33-45d9-4e6e-975b-0c71070be3bb]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:33 devstack sudo[86234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca Apr 22 09:23:33 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:33 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e" returned: 0 in 0.537s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:33 devstack sudo[86239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d 1G Apr 22 09:23:33 devstack sudo[86239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:33 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca" returned: 0 in 0.515s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e17bb45c-72fe-4564-b37f-687659bc0e22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:33 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f1b812-dec4-43aa-8136-e73ab9b65662]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:33 devstack sudo[86244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 Apr 22 09:23:33 devstack sudo[86244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:33 devstack sudo[86239]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d 1G" returned: 0 in 0.552s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:33 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:23:33 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:34 devstack sudo[86244]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22" returned: 0 in 0.531s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:34 devstack sudo[86254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca Apr 22 09:23:34 devstack sudo[86254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:34 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 0.526s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:34 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d is being set with open permissions: ugo+rw Apr 22 09:23:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:34 devstack sudo[86262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:23:34 devstack sudo[86262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:34 devstack sudo[86254]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca" returned: 0 in 0.509s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:34 devstack sudo[86264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca Apr 22 09:23:34 devstack sudo[86264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:34 devstack sudo[86262]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 0.496s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:34 devstack sudo[86268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.info Apr 22 09:23:34 devstack sudo[86268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:35 devstack sudo[86264]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22.d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca" returned: 0 in 0.469s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-d2e7d7fc-2b55-4abd-93aa-d7f6c6bb7dca" released by "_delete_snapshot" :: held 2.073s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-e17bb45c-72fe-4564-b37f-687659bc0e22" released by "delete_snapshot" :: held 2.082s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:35 devstack cinder-volume[82642]: WARNING cinder.quota [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1071254650 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1071254650, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:23:35 devstack cinder-volume[82642]: WARNING cinder.quota [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1071254650 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1071254650, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:23:35 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Created reservations ['b36547e5-0190-4bd5-a005-9d5f64bbcaaf', 'abe34587-fc6b-41c5-babc-a16225f49ba9', '197842bf-b368-4aea-a8ea-58ffcac70a19', '45c3ed05-16c7-4bb0-a904-723f11b6757e'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:35 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] Created reservations ['df87e2fd-990c-4586-a3f3-63712bd01a94', '60b1ec34-3a7f-4129-84af-05d187a84852', 'f6f81387-6070-4220-898e-3e388ae94feb', 'edb09207-1d89-4b34-af6c-6ee31f00b825'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:35 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0016cf37-d721-4302-9b7c-f7af581fb5c9 tempest-GroupSnapshotsTest-859463721 None] group_snapshot 789f5db0-fc8f-42ce-89fd-b9d6b304ab82: deleted successfully Apr 22 09:23:35 devstack sudo[86268]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.info" returned: 0 in 0.492s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:35 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.info is being set with open permissions: ugo+rw Apr 22 09:23:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:35 devstack sudo[86271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.info Apr 22 09:23:35 devstack sudo[86271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:35 devstack sudo[86271]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.info" returned: 0 in 0.527s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.198s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:36 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4fd73c1b-7502-4c0d-9e65-e80bea43b774 tempest-SnapshotsActionsTest-402326745 None] Create snapshot completed successfully Apr 22 09:23:36 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-0215edf0-57f2-41fe-b9fd-1a97d789a81f" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:36 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-0215edf0-57f2-41fe-b9fd-1a97d789a81f" acquired by "delete_volume" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:36 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2379b1-6825-450b-a9ff-e1a288305743]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:36 devstack sudo[86279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f Apr 22 09:23:36 devstack sudo[86279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:37 devstack sudo[86279]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f" returned: 0 in 0.593s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:37 devstack sudo[86320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f Apr 22 09:23:37 devstack sudo[86320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:37 devstack sudo[86320]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0215edf0-57f2-41fe-b9fd-1a97d789a81f" returned: 0 in 0.663s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-0215edf0-57f2-41fe-b9fd-1a97d789a81f" released by "delete_volume" :: held 1.316s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-e17bb45c-72fe-4564-b37f-687659bc0e22" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] Creating offline snapshot be315d1f-3bdc-42b7-a718-4214cd5dda5f of volume 8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a915922d-f109-4ea0-ab98-27e25b949331]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-e17bb45c-72fe-4564-b37f-687659bc0e22" acquired by "delete_volume" :: waited 0.040s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4945ec5-75ae-4729-ac93-b65f76ea0466]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:37 devstack sudo[86349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:23:37 devstack sudo[86349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:37 devstack sudo[86350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 Apr 22 09:23:37 devstack sudo[86350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:38 devstack sudo[86349]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 0.532s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:38 devstack sudo[86367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f 1G Apr 22 09:23:38 devstack sudo[86367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:38 devstack sudo[86350]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22" returned: 0 in 0.555s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:38 devstack sudo[86369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22 Apr 22 09:23:38 devstack sudo[86369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:38 devstack sudo[86367]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f 1G" returned: 0 in 0.684s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:38 devstack sudo[86369]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e17bb45c-72fe-4564-b37f-687659bc0e22" returned: 0 in 0.643s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:38 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-e17bb45c-72fe-4564-b37f-687659bc0e22" released by "delete_volume" :: held 1.233s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:38 devstack sudo[86396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f Apr 22 09:23:38 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Created reservations ['d5ac4585-9c18-4a1b-b78e-92bfe15b8516'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:39 devstack cinder-volume[82642]: WARNING cinder.quota [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1071254650 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1071254650, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Created reservations ['e3a01f5f-62e5-4fbf-af26-31ba460f6b44', '809799e9-e657-4505-b8c8-981efef7ee37', '2127ac5a-37f8-4a12-9a7d-2412124986ea', 'fde9ff51-db2e-4db8-816c-cfa9ca4cf60b'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Created reservations ['725c7c5a-cc83-4b28-8d2a-1806dd0cbb0c', '265f26fc-7b64-4182-b8cb-c3488460c562', 'e5303101-36ec-4ebb-b860-401d58b028c9', '9ed890b7-e59c-4d44-a989-f5bde3b44bbb'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:39 devstack sudo[86410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:23:39 devstack sudo[86410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:39 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f" returned: 0 in 0.725s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:39 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f is being set with open permissions: ugo+rw Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:39 devstack sudo[86419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f Apr 22 09:23:39 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:39 devstack sudo[86410]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.690s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:39 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:23:39 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4c2df4f8-a0f2-4754-b24e-1324efd4a4fc tempest-GroupSnapshotsTest-859463721 None] Delete group completed successfully. Apr 22 09:23:40 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0d7acc2a-9222-4b5e-a83b-9ea33c965b18 tempest-GroupSnapshotsTest-859463721 None] Group tempest-GroupSnapshotsTest-Group-168578760: creating Apr 22 09:23:40 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0d7acc2a-9222-4b5e-a83b-9ea33c965b18 tempest-GroupSnapshotsTest-859463721 None] Group tempest-GroupSnapshotsTest-Group-168578760: created successfully Apr 22 09:23:40 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0d7acc2a-9222-4b5e-a83b-9ea33c965b18 tempest-GroupSnapshotsTest-859463721 None] Create group completed successfully. Apr 22 09:23:40 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f" returned: 0 in 0.626s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.622s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:40 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e41c32ed-9923-41fa-a919-1c4352c7be2a tempest-SnapshotsActionsTest-402326745 None] Create snapshot completed successfully Apr 22 09:23:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-be315d1f-3bdc-42b7-a718-4214cd5dda5f-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-be315d1f-3bdc-42b7-a718-4214cd5dda5f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-quobyte-be315d1f-3bdc-42b7-a718-4214cd5dda5f" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-be315d1f-3bdc-42b7-a718-4214cd5dda5f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Deleting offline snapshot be315d1f-3bdc-42b7-a718-4214cd5dda5f of volume 8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] snapshot_file for this snap is: volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[359c6ec8-afd7-4377-b8da-df82008e98d3]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:41 devstack sudo[86428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f Apr 22 09:23:41 devstack sudo[86428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Flow 'volume_create_manager' (1f87934b-f6a9-4082-9eb9-4577c9ff6eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fe1bde-8c49-443c-974d-a615b20bc5bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9fe1bde-8c49-443c-974d-a615b20bc5bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1329729659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f388847-6fd2-4b9b-a146-c081f6dbfea4,host='devstack@QuobyteHD#QuobyteHD',id=8f53b6d7-f775-4197-87c3-65fab9962716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11700ff62a149bc852fe3aaaa140e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:23:42Z,use_quota=True,user_id='6e6b03f4807f4ac7aefd189227dfa60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62311bc5-7ac6-4b45-b082-147c2e699688),volume_type_id=62311bc5-7ac6-4b45-b082-147c2e699688)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2935c364-cce5-42dc-9b5b-7d1133313c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2935c364-cce5-42dc-9b5b-7d1133313c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091dcb54-74a8-487a-be51-231ff4c4f542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (091dcb54-74a8-487a-be51-231ff4c4f542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f53b6d7-f775-4197-87c3-65fab9962716', 'volume_name': 'volume-8f53b6d7-f775-4197-87c3-65fab9962716', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e315c9-5e50-4710-bf19-ac633c14bbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e315c9-5e50-4710-bf19-ac633c14bbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c504fb4-8e47-4a27-a99c-6ce0d5fd59b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:41 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Volume 8f53b6d7-f775-4197-87c3-65fab9962716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f53b6d7-f775-4197-87c3-65fab9962716', 'volume_size': 1} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4f388847-6fd2-4b9b-a146-c081f6dbfea4,created_at=2026-04-22T07:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1329729659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4f388847-6fd2-4b9b-a146-c081f6dbfea4,host='devstack@QuobyteHD#QuobyteHD',id=8f53b6d7-f775-4197-87c3-65fab9962716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c11700ff62a149bc852fe3aaaa140e02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:23:42Z,use_quota=True,user_id='6e6b03f4807f4ac7aefd189227dfa60c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62311bc5-7ac6-4b45-b082-147c2e699688),volume_type_id=62311bc5-7ac6-4b45-b082-147c2e699688)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Creating volume 8f53b6d7-f775-4197-87c3-65fab9962716 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:23:41 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:23:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:41 devstack sudo[86437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 1073741824 Apr 22 09:23:41 devstack sudo[86437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:42 devstack sudo[86428]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f" returned: 0 in 1.080s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:42 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:42 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cfdbdc-8447-45e4-9f89-80c73139320f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:42 devstack sudo[86447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:23:42 devstack sudo[86447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:42 devstack sudo[86437]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 1073741824" returned: 0 in 0.935s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:42 devstack sudo[86477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 Apr 22 09:23:42 devstack sudo[86477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:43 devstack sudo[86447]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 0.928s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:43 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:43 devstack sudo[86482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f Apr 22 09:23:43 devstack sudo[86482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:43 devstack sudo[86477]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716" returned: 0 in 1.065s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:43 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:23:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:43 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c504fb4-8e47-4a27-a99c-6ce0d5fd59b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f53b6d7-f775-4197-87c3-65fab9962716', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:43 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344f79eb-9354-4da6-8ee3-ad7333347fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:23:44 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Volume volume-8f53b6d7-f775-4197-87c3-65fab9962716 (8f53b6d7-f775-4197-87c3-65fab9962716): created successfully Apr 22 09:23:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (344f79eb-9354-4da6-8ee3-ad7333347fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:23:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Flow 'volume_create_manager' (1f87934b-f6a9-4082-9eb9-4577c9ff6eea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:23:44 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-a4a0a02c-209e-4173-aab2-79e24151cf70 tempest-GroupSnapshotsTest-859463721 None] Created volume successfully. Apr 22 09:23:44 devstack sudo[86482]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f" returned: 0 in 0.964s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:44 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f Apr 22 09:23:44 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:44 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.be315d1f-3bdc-42b7-a718-4214cd5dda5f" returned: 0 in 0.487s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:44 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-be315d1f-3bdc-42b7-a718-4214cd5dda5f" released by "_delete_snapshot" :: held 3.602s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:44 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" released by "delete_snapshot" :: held 3.622s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:44 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Created reservations ['245df1ed-dd4c-43a7-ab9f-15635499cb94', '78adfd84-939c-46d2-8603-556a9e945a36', 'b637e884-16a1-44ba-9461-7f38478f2527', 'ab225364-fd9b-43b6-b85a-2a2f44c02165'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:44 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Delete snapshot completed successfully. Apr 22 09:23:44 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d996ada8-6c14-45d1-850e-6b37f452d617 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-be315d1f-3bdc-42b7-a718-4214cd5dda5f-delete_snapshot" released by "delete_snapshot" :: held 3.733s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:45 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] GroupSnapshot b2c8f39c-0cf2-420d-b01a-cc68a60363af: creating. Apr 22 09:23:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] Group snapshot b2c8f39c-0cf2-420d-b01a-cc68a60363af: creating. {{(pid=82642) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4209}} Apr 22 09:23:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] Creating offline snapshot b226e6e8-be3d-463b-9e7a-5475d060ed7e of volume 8f53b6d7-f775-4197-87c3-65fab9962716 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:23:45 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaaee4b8-0fec-45bd-a11f-ef4b9c1e6d2c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:45 devstack sudo[86495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 Apr 22 09:23:45 devstack sudo[86495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:45 devstack sudo[86495]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716" returned: 0 in 0.723s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:45 devstack sudo[86507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e 1G Apr 22 09:23:45 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:46 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e 1G" returned: 0 in 0.773s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f53b6d7-f775-4197-87c3-65fab9962716 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:46 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f53b6d7-f775-4197-87c3-65fab9962716 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e Apr 22 09:23:46 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:47 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f53b6d7-f775-4197-87c3-65fab9962716 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e" returned: 0 in 0.480s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:47 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:23:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:47 devstack sudo[86541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e Apr 22 09:23:47 devstack sudo[86541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:47 devstack sudo[86541]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e" returned: 0 in 0.520s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:47 devstack sudo[86546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.info Apr 22 09:23:47 devstack sudo[86546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:48 devstack sudo[86546]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.info" returned: 0 in 0.488s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:48 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.info is being set with open permissions: ugo+rw: NotImplementedError Apr 22 09:23:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:48 devstack sudo[86563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.info Apr 22 09:23:48 devstack sudo[86563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:48 devstack sudo[86563]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.info" returned: 0 in 0.455s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.510s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.148s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] Creating offline snapshot 9908231a-f302-455d-af62-6e29514b39e1 of volume 8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:23:48 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfa6dd5-f6ea-4014-a75f-5e1bd6efa740]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:48 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-74924856-7d79-46ca-933a-b36b1b51bf25 tempest-GroupSnapshotsTest-859463721 None] group_snapshot b2c8f39c-0cf2-420d-b01a-cc68a60363af: created successfully Apr 22 09:23:48 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:23:48 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:49 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 0.540s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:49 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 1G Apr 22 09:23:49 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:49 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] group_snapshot b2c8f39c-0cf2-420d-b01a-cc68a60363af: deleting Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] group_snapshot b2c8f39c-0cf2-420d-b01a-cc68a60363af: deleting {{(pid=82642) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4384}} Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-8f53b6d7-f775-4197-87c3-65fab9962716" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-8f53b6d7-f775-4197-87c3-65fab9962716" acquired by "delete_snapshot" :: waited 0.043s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-b226e6e8-be3d-463b-9e7a-5475d060ed7e" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-b226e6e8-be3d-463b-9e7a-5475d060ed7e" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Deleting offline snapshot b226e6e8-be3d-463b-9e7a-5475d060ed7e of volume 8f53b6d7-f775-4197-87c3-65fab9962716 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] snapshot_file for this snap is: volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a289aff3-8bb4-4055-83cd-d1afb4021f6d]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:49 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e Apr 22 09:23:49 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:49 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 1G" returned: 0 in 0.612s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:49 devstack sudo[86583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 Apr 22 09:23:49 devstack sudo[86583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:50 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e" returned: 0 in 0.568s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:50 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f53b6d7-f775-4197-87c3-65fab9962716(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:50 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a6bbd2-f1a1-4bc9-996b-cfa980b288fb]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:50 devstack sudo[86588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 Apr 22 09:23:50 devstack sudo[86588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:50 devstack sudo[86583]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1" returned: 0 in 0.543s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:50 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 is being set with open permissions: ugo+rw Apr 22 09:23:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:50 devstack sudo[86593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 Apr 22 09:23:50 devstack sudo[86593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:50 devstack sudo[86588]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716" returned: 0 in 0.544s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:50 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e Apr 22 09:23:50 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:50 devstack sudo[86593]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1" returned: 0 in 0.484s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.240s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:50 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b89f8dbc-1333-459d-9ab7-dbb23ff08a9d tempest-SnapshotsActionsTest-402326745 None] Create snapshot completed successfully Apr 22 09:23:51 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e" returned: 0 in 0.563s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:51 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e Apr 22 09:23:51 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-9908231a-f302-455d-af62-6e29514b39e1-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-9908231a-f302-455d-af62-6e29514b39e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:51 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-quobyte-9908231a-f302-455d-af62-6e29514b39e1" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716.b226e6e8-be3d-463b-9e7a-5475d060ed7e" returned: 0 in 0.599s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-b226e6e8-be3d-463b-9e7a-5475d060ed7e" released by "_delete_snapshot" :: held 2.336s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-9908231a-f302-455d-af62-6e29514b39e1" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Deleting offline snapshot 9908231a-f302-455d-af62-6e29514b39e1 of volume 8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] snapshot_file for this snap is: volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-8f53b6d7-f775-4197-87c3-65fab9962716" released by "delete_snapshot" :: held 2.368s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c83f7ec5-8b24-4ced-ad44-0e6b6f378e61]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:52 devstack cinder-volume[82642]: WARNING cinder.quota [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-607208564 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-607208564, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:23:52 devstack cinder-volume[82642]: WARNING cinder.quota [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-607208564 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-607208564, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:23:52 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] Created reservations ['baa888b2-fa7e-4ac6-b8eb-4e9f9a4c9c36', '663a8f62-40f8-4171-a2f7-0aff3e53926a', '720457b3-4614-4fb0-84b5-f64c065e6ced', 'f82ff2bc-d02b-4504-9395-2ad7fc04b5f4'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:52 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 Apr 22 09:23:52 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:52 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b0e7af5a-fdac-4513-8035-5e655ae74080 tempest-GroupSnapshotsTest-859463721 None] group_snapshot b2c8f39c-0cf2-420d-b01a-cc68a60363af: deleted successfully Apr 22 09:23:52 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1" returned: 0 in 0.796s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:52 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c672a00c-6e49-417b-999f-ab119630506f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:53 devstack sudo[86619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:23:53 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "cinder-quobyte-8f53b6d7-f775-4197-87c3-65fab9962716" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:23:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-8f53b6d7-f775-4197-87c3-65fab9962716" acquired by "delete_volume" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:23:53 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da33d64-f5d0-4097-9d8b-2d4d89bcc095]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:53 devstack sudo[86629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 Apr 22 09:23:53 devstack sudo[86629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:53 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 1.134s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:54 devstack sudo[86660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 Apr 22 09:23:54 devstack sudo[86660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:54 devstack sudo[86629]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716" returned: 0 in 1.080s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:54 devstack sudo[86681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716 Apr 22 09:23:54 devstack sudo[86681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:55 devstack sudo[86681]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8f53b6d7-f775-4197-87c3-65fab9962716" returned: 0 in 0.559s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Lock "cinder-quobyte-8f53b6d7-f775-4197-87c3-65fab9962716" released by "delete_volume" :: held 1.732s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:55 devstack sudo[86660]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1" returned: 0 in 1.160s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Created reservations ['5c607b77-1797-497d-bd40-62a75c2afb54'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:55 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1 Apr 22 09:23:55 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:55 devstack cinder-volume[82642]: WARNING cinder.quota [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-607208564 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-607208564, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Created reservations ['5cd08ca4-83cd-4817-b500-e8da7d6782ff', 'e9f683e6-14b3-4613-98ba-bc266b1b7814', 'ca60d6ef-965d-4e49-b29a-32ff0fe7d2d8', '5b850f36-f9e1-453b-b87f-d6b8508177a9'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:55 devstack sudo[86693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:23:55 devstack sudo[86693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:55 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.9908231a-f302-455d-af62-6e29514b39e1" returned: 0 in 0.502s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-9908231a-f302-455d-af62-6e29514b39e1" released by "_delete_snapshot" :: held 3.679s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" released by "delete_snapshot" :: held 3.713s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Created reservations ['512b6f12-76f2-453c-af6d-899ec377c53a', '5c40797e-2267-414f-96f4-8405f9ed6bcc', '8435cc04-499c-4cae-80d0-8ebd0e15ae9a', '9e36d2a9-29bd-4cdf-9917-b0f0d0e467c3'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:23:55 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Delete snapshot completed successfully. Apr 22 09:23:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-496b331d-5022-4770-921e-a6c6889b17e0 tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-9908231a-f302-455d-af62-6e29514b39e1-delete_snapshot" released by "delete_snapshot" :: held 4.043s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:23:56 devstack sudo[86693]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 1.219s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:56 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:23:56 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-29a68ab8-2e78-4d61-9194-0ad32167148a tempest-GroupSnapshotsTest-859463721 None] Delete group completed successfully. Apr 22 09:23:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:23:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:23:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] Creating offline snapshot 13c3db35-5d76-4d50-b38d-d6f18dfc7535 of volume 8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:23:56 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[385ab0e7-8b3e-475a-9d85-9badab0bf31c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:23:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:56 devstack sudo[86699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:23:56 devstack sudo[86699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:57 devstack sudo[86699]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 0.689s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:23:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:57 devstack sudo[86706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 1G Apr 22 09:23:57 devstack sudo[86706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:58 devstack sudo[86706]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 1G" returned: 0 in 0.940s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:58 devstack sudo[86713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 Apr 22 09:23:58 devstack sudo[86713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:59 devstack sudo[86713]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535" returned: 0 in 0.595s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:59 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 is being set with open permissions: ugo+rw Apr 22 09:23:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:23:59 devstack sudo[86731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 Apr 22 09:23:59 devstack sudo[86731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:23:59 devstack sudo[86731]: pam_unix(sudo:session): session closed for user root Apr 22 09:23:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535" returned: 0 in 0.771s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:23:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.177s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:23:59 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c129251f-e19b-44d8-92bc-d9164dda77fb tempest-SnapshotsActionsTest-402326745 None] Create snapshot completed successfully Apr 22 09:24:00 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d456e50c-a6d9-4375-857c-d83c5c2b888b tempest-GroupsV320Test-1182769811 None] Group tempest-GroupsV320Test-Group-267485166: creating Apr 22 09:24:00 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d456e50c-a6d9-4375-857c-d83c5c2b888b tempest-GroupsV320Test-1182769811 None] Group tempest-GroupsV320Test-Group-267485166: created successfully Apr 22 09:24:00 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d456e50c-a6d9-4375-857c-d83c5c2b888b tempest-GroupsV320Test-1182769811 None] Create group completed successfully. Apr 22 09:24:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-13c3db35-5d76-4d50-b38d-d6f18dfc7535-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-13c3db35-5d76-4d50-b38d-d6f18dfc7535-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-quobyte-13c3db35-5d76-4d50-b38d-d6f18dfc7535" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-13c3db35-5d76-4d50-b38d-d6f18dfc7535" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Deleting offline snapshot 13c3db35-5d76-4d50-b38d-d6f18dfc7535 of volume 8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:24:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] snapshot_file for this snap is: volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:24:01 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48df909-be1f-4005-88fa-412751504205]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:01 devstack sudo[86778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 Apr 22 09:24:01 devstack sudo[86778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:01 devstack sudo[86778]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535" returned: 0 in 0.546s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:24:01 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74caf80-119f-4c23-afe9-7576c7fc7464]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:01 devstack sudo[86793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:24:01 devstack sudo[86793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:02 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-394256da-515b-457e-b991-f3977db845ba tempest-GroupsV320Test-1182769811 None] Created reservations ['2d788140-26e4-44db-96f6-949ee55ac624'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:02 devstack sudo[86793]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 1.278s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:24:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-394256da-515b-457e-b991-f3977db845ba tempest-GroupsV320Test-1182769811 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-394256da-515b-457e-b991-f3977db845ba tempest-GroupsV320Test-1182769811 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-394256da-515b-457e-b991-f3977db845ba tempest-GroupsV320Test-1182769811 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-394256da-515b-457e-b991-f3977db845ba tempest-GroupsV320Test-1182769811 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-394256da-515b-457e-b991-f3977db845ba tempest-GroupsV320Test-1182769811 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-394256da-515b-457e-b991-f3977db845ba tempest-GroupsV320Test-1182769811 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:02 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:02 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:02 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 Apr 22 09:24:02 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:03 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-394256da-515b-457e-b991-f3977db845ba tempest-GroupsV320Test-1182769811 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.621s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:03 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-394256da-515b-457e-b991-f3977db845ba tempest-GroupsV320Test-1182769811 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:03 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-394256da-515b-457e-b991-f3977db845ba tempest-GroupsV320Test-1182769811 None] Delete group completed successfully. Apr 22 09:24:03 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535" returned: 0 in 0.804s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:03 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535 Apr 22 09:24:03 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:04 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.13c3db35-5d76-4d50-b38d-d6f18dfc7535" returned: 0 in 0.758s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-13c3db35-5d76-4d50-b38d-d6f18dfc7535" released by "_delete_snapshot" :: held 3.456s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" released by "delete_snapshot" :: held 3.468s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:04 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Created reservations ['92604319-ea20-4a56-b6a3-fdbbdd710bfb', '9fb83319-54d9-457b-8990-22aab55a325e', 'f69a08a8-e268-4b55-b061-94dc3ac9aafa', 'a59a6c9b-f7ca-41f5-9473-dc6c34105fb4'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:04 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Delete snapshot completed successfully. Apr 22 09:24:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad9e049e-b093-46a0-a7d4-6192fc745d3e tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-13c3db35-5d76-4d50-b38d-d6f18dfc7535-delete_snapshot" released by "delete_snapshot" :: held 3.614s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] Creating offline snapshot 077aac0d-a9b3-470c-9d9e-38fb604d7468 of volume 8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:24:05 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8329e578-a472-4002-ad9a-5cd245f71b7b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:05 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:24:06 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:06 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 1.179s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:24:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:07 devstack sudo[86895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 1G Apr 22 09:24:07 devstack sudo[86895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:08 devstack sudo[86895]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 1G" returned: 0 in 1.260s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:08 devstack sudo[86970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 Apr 22 09:24:08 devstack sudo[86970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:08 devstack sudo[86970]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468" returned: 0 in 0.555s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:08 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 is being set with open permissions: ugo+rw Apr 22 09:24:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:08 devstack sudo[86980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 Apr 22 09:24:08 devstack sudo[86980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:09 devstack sudo[86980]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468" returned: 0 in 0.474s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.599s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:09 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-47563a70-9e83-4df2-9877-431f7bf3604f tempest-SnapshotsActionsTest-402326745 None] Create snapshot completed successfully Apr 22 09:24:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-077aac0d-a9b3-470c-9d9e-38fb604d7468-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-077aac0d-a9b3-470c-9d9e-38fb604d7468-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Acquiring lock "cinder-quobyte-077aac0d-a9b3-470c-9d9e-38fb604d7468" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-077aac0d-a9b3-470c-9d9e-38fb604d7468" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Deleting offline snapshot 077aac0d-a9b3-470c-9d9e-38fb604d7468 of volume 8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:24:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] snapshot_file for this snap is: volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:24:10 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b5d3eb-47c8-44a4-a367-8fc302263a25]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:10 devstack sudo[86989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 Apr 22 09:24:10 devstack sudo[86989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:10 devstack sudo[86989]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468" returned: 0 in 0.501s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:24:10 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19e2864-3f12-4d78-9f99-c7436bb8e5b4]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:10 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6da173cd-ba6d-4e6e-a9bd-0c1453141632 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Terminate volume connection completed successfully. Apr 22 09:24:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6da173cd-ba6d-4e6e-a9bd-0c1453141632 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Deleting attachment 70bed6ff-76f5-44db-bef0-79af17e47101. {{(pid=82642) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5089}} Apr 22 09:24:10 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:24:10 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:11 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 0.472s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:11 devstack sudo[87001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 Apr 22 09:24:11 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "cinder-1200b6cd-dbdc-4842-9dd3-d4a89715877f-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "cinder-1200b6cd-dbdc-4842-9dd3-d4a89715877f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "cinder-quobyte-1200b6cd-dbdc-4842-9dd3-d4a89715877f" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "cinder-quobyte-1200b6cd-dbdc-4842-9dd3-d4a89715877f" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d425a54b-36db-4af5-a6ef-868f59141ac3]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:11 devstack sudo[87004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f Apr 22 09:24:11 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:11 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468" returned: 0 in 0.520s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:11 devstack sudo[87009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468 Apr 22 09:24:11 devstack sudo[87009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:11 devstack sudo[87009]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.077aac0d-a9b3-470c-9d9e-38fb604d7468" returned: 0 in 0.426s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-077aac0d-a9b3-470c-9d9e-38fb604d7468" released by "_delete_snapshot" :: held 1.986s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" released by "delete_snapshot" :: held 1.999s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Created reservations ['014a404d-3508-4e98-a973-9927917a834c', '6847a3aa-161d-482d-9020-c520304ec870', '92f715bd-31bc-4469-8f26-f48ef5e606ed', '790e0a6e-0c77-41e4-a9d0-6f2cc18e3a78'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:12 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Delete snapshot completed successfully. Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27592276-fa46-47ab-be48-e13bfda4327f tempest-SnapshotsActionsTest-1916624731 None] Lock "cinder-077aac0d-a9b3-470c-9d9e-38fb604d7468-delete_snapshot" released by "delete_snapshot" :: held 2.091s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:12 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f" returned: 0 in 0.756s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:12 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f Apr 22 09:24:12 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "cinder-5401eaf9-88c3-459f-8ff7-ac3cdc111a8d-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Lock "cinder-5401eaf9-88c3-459f-8ff7-ac3cdc111a8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "cinder-quobyte-5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Lock "cinder-quobyte-5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Deleting offline snapshot 5401eaf9-88c3-459f-8ff7-ac3cdc111a8d of volume 8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] snapshot_file for this snap is: volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[497597fb-6949-41c2-b05b-2147d9d8d64c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:12 devstack sudo[87016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:24:12 devstack sudo[87016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:12 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f" returned: 1 in 0.559s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:24:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:12 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f Apr 22 09:24:12 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:13 devstack sudo[87016]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 0.679s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c672747-d7cc-4118-80c8-18f4628d167e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eba1a3-f190-4cd7-8920-cb68b14280f8]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:13 devstack sudo[87026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e Apr 22 09:24:13 devstack sudo[87026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:13 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-1200b6cd-dbdc-4842-9dd3-d4a89715877f" returned: 0 in 0.648s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "cinder-quobyte-1200b6cd-dbdc-4842-9dd3-d4a89715877f" released by "delete_volume" :: held 2.023s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG cinder.quota [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Created reservations ['a5e1d7a3-093e-4373-9345-cf0d67e11f78', '0d3948c7-04b9-4bf8-a7fa-38af711d36d8', 'b9d2cad3-cf0e-4822-9e79-f2f434a63b3c', '4cede851-0400-4180-9ed6-5e242baf5857'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:13 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:13 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:13 devstack sudo[87026]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e" returned: 0 in 0.619s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:13 devstack sudo[87035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:24:13 devstack sudo[87035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:13 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.512s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG cinder.manager [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:13 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Deleted volume successfully. Apr 22 09:24:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-7142ed5e-e5f9-47df-adf3-63d8a49fc62f req-6dc6aa2c-9a71-4beb-bc9e-84146a43a5ea tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "cinder-1200b6cd-dbdc-4842-9dd3-d4a89715877f-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:14 devstack sudo[87035]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 0.699s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:14 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d Apr 22 09:24:14 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Flow 'volume_create_manager' (3ab0e76f-9a54-4f1c-84e1-2ce700443e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62c5364-9f13-4e71-9297-d3f86e247d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d62c5364-9f13-4e71-9297-d3f86e247d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-630014881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3321a9-57f6-4200-8067-e0809dd89b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235a603ac7ba4c309990d9515030bc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:15Z,use_quota=True,user_id='9fd76e4d453b44ed8c7bb98a798b5311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6974c07c-cefb-455e-84b4-aa41ed2ca3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6974c07c-cefb-455e-84b4-aa41ed2ca3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5944f89-7fdc-4390-9384-ee4f523819fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5944f89-7fdc-4390-9384-ee4f523819fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a3321a9-57f6-4200-8067-e0809dd89b91', 'volume_name': 'volume-8a3321a9-57f6-4200-8067-e0809dd89b91', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb03f665-5118-4d81-9c07-d87ffe90d462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb03f665-5118-4d81-9c07-d87ffe90d462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb46f90-efb9-4b3b-a329-b00a5ae996d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:15 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Volume 8a3321a9-57f6-4200-8067-e0809dd89b91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a3321a9-57f6-4200-8067-e0809dd89b91', 'volume_size': 1} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-630014881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a3321a9-57f6-4200-8067-e0809dd89b91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235a603ac7ba4c309990d9515030bc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:15Z,use_quota=True,user_id='9fd76e4d453b44ed8c7bb98a798b5311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Creating volume 8a3321a9-57f6-4200-8067-e0809dd89b91 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:15 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:15 devstack sudo[87044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91 1073741824 Apr 22 09:24:15 devstack sudo[87044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:15 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e.5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" returned: 0 in 0.738s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Lock "cinder-quobyte-5401eaf9-88c3-459f-8ff7-ac3cdc111a8d" released by "_delete_snapshot" :: held 2.807s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" released by "delete_snapshot" :: held 2.820s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Created reservations ['926df7c8-8fc7-4553-b954-58cdc9acbabe', 'de0237a1-79ba-40dd-9c5c-31b10eec53be', 'c9a3b06f-2071-4474-b323-0e9c8f8064ac', '89fb1697-61f8-42f4-92f0-2105ebccee1f'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:15 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Delete snapshot completed successfully. Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bb9db3ad-7a84-4ee7-9f7d-3a697ae66f26 tempest-SnapshotsActionsTest-402326745 None] Lock "cinder-5401eaf9-88c3-459f-8ff7-ac3cdc111a8d-delete_snapshot" released by "delete_snapshot" :: held 2.904s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "cinder-8c672747-d7cc-4118-80c8-18f4628d167e-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Lock "cinder-8c672747-d7cc-4118-80c8-18f4628d167e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" acquired by "delete_volume" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:15 devstack sudo[87044]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91 1073741824" returned: 0 in 0.760s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d5dfc8-073e-498d-a14a-bd44ff5c2424]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:15 devstack sudo[87061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91 Apr 22 09:24:15 devstack sudo[87061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:16 devstack sudo[87060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e Apr 22 09:24:16 devstack sudo[87060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:16 devstack sudo[87061]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91" returned: 0 in 0.708s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] <== create_volume: return (1530ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecb46f90-efb9-4b3b-a329-b00a5ae996d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a3321a9-57f6-4200-8067-e0809dd89b91', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa509960-7ca2-403a-8063-88c8cadb4ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:16 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Volume volume-8a3321a9-57f6-4200-8067-e0809dd89b91 (8a3321a9-57f6-4200-8067-e0809dd89b91): created successfully Apr 22 09:24:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa509960-7ca2-403a-8063-88c8cadb4ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Flow 'volume_create_manager' (3ab0e76f-9a54-4f1c-84e1-2ce700443e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e38140dc-6a8e-4dff-ab51-40045fb199a7 tempest-ServersNegativeTestJSON-58459114 None] Created volume successfully. Apr 22 09:24:16 devstack sudo[87060]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e" returned: 0 in 0.910s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:16 devstack sudo[87087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e Apr 22 09:24:16 devstack sudo[87087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:17 devstack sudo[87087]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8c672747-d7cc-4118-80c8-18f4628d167e" returned: 0 in 0.487s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Lock "cinder-quobyte-8c672747-d7cc-4118-80c8-18f4628d167e" released by "delete_volume" :: held 1.461s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:17 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Created reservations ['001f27a9-1e71-4c8f-8e63-3d769a2fbec1', 'd8361aba-55e6-46c0-8f4d-483aab782f4c', '086c480d-ebb3-4f67-8845-6b7664351ef5', '65beae57-9bf1-4c16-a0f1-5572bf6e5861'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:17 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:17 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:18 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.584s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:18 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Deleted volume successfully. Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c646cb2f-5af2-49b8-a796-838429e04982 tempest-SnapshotsActionsTest-402326745 None] Lock "cinder-8c672747-d7cc-4118-80c8-18f4628d167e-delete_volume" released by "delete_volume" :: held 2.282s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Flow 'volume_create_manager' (e3f6ff69-ebf6-465e-84d3-d72c66b205a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3581c8d9-0555-44c0-b4e5-00fe64b6ec8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3581c8d9-0555-44c0-b4e5-00fe64b6ec8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-972995252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb7668a-1309-428d-bdb5-ea1b71d8408e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235a603ac7ba4c309990d9515030bc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:19Z,use_quota=True,user_id='9fd76e4d453b44ed8c7bb98a798b5311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3f0a02-0852-499a-8208-19a487294152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f3f0a02-0852-499a-8208-19a487294152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03397b47-489e-400d-8bbc-2ac19943a7d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03397b47-489e-400d-8bbc-2ac19943a7d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbb7668a-1309-428d-bdb5-ea1b71d8408e', 'volume_name': 'volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5845f2ab-dcbb-4723-b2bd-f8fdac08758d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5845f2ab-dcbb-4723-b2bd-f8fdac08758d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab72ccf5-21cb-4575-89bc-3c9319d67229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:18 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Volume fbb7668a-1309-428d-bdb5-ea1b71d8408e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e', 'volume_size': 1} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-972995252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb7668a-1309-428d-bdb5-ea1b71d8408e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='235a603ac7ba4c309990d9515030bc6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:19Z,use_quota=True,user_id='9fd76e4d453b44ed8c7bb98a798b5311',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Creating volume fbb7668a-1309-428d-bdb5-ea1b71d8408e {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:18 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:18 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e 1073741824 Apr 22 09:24:18 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:19 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e 1073741824" returned: 0 in 0.700s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:19 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e Apr 22 09:24:19 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:20 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e" returned: 0 in 0.605s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] <== create_volume: return (1333ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab72ccf5-21cb-4575-89bc-3c9319d67229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a2654c-2724-4194-a94e-fd3b619610ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:20 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Volume volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e (fbb7668a-1309-428d-bdb5-ea1b71d8408e): created successfully Apr 22 09:24:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64a2654c-2724-4194-a94e-fd3b619610ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Flow 'volume_create_manager' (e3f6ff69-ebf6-465e-84d3-d72c66b205a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:20 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d5336168-ce12-4972-8b90-d14c4b8255a3 tempest-ServersNegativeTestJSON-58459114 None] Created volume successfully. Apr 22 09:24:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Acquiring lock "cinder-fbb7668a-1309-428d-bdb5-ea1b71d8408e-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Lock "cinder-fbb7668a-1309-428d-bdb5-ea1b71d8408e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Acquiring lock "cinder-quobyte-fbb7668a-1309-428d-bdb5-ea1b71d8408e" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Lock "cinder-quobyte-fbb7668a-1309-428d-bdb5-ea1b71d8408e" acquired by "delete_volume" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:21 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e6b6d7-cf4f-4956-9c3e-f91e6bcd4fc0]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:21 devstack sudo[87104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e Apr 22 09:24:21 devstack sudo[87104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:21 devstack sudo[87104]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e" returned: 0 in 0.547s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:21 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e Apr 22 09:24:21 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:22 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fbb7668a-1309-428d-bdb5-ea1b71d8408e" returned: 0 in 0.469s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Flow 'volume_create_manager' (3ac28d79-e4f8-4584-8a4b-72e2ab705ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75867770-3e8b-4524-ab6c-2125c53fc082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Lock "cinder-quobyte-fbb7668a-1309-428d-bdb5-ea1b71d8408e" released by "delete_volume" :: held 1.077s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75867770-3e8b-4524-ab6c-2125c53fc082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-560593064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407c6a97-57bd-4391-a194-07efeb641342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eee8dc7f4454256b4cbd19a9419f811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:22Z,use_quota=True,user_id='1cb77dbd66f348a8b81ce77634dd2d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b26d690-78c4-4a38-aea9-b6cc336a079a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b26d690-78c4-4a38-aea9-b6cc336a079a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff0123a-f0b5-4d4c-a0f4-4ebe9ae86f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ff0123a-f0b5-4d4c-a0f4-4ebe9ae86f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407c6a97-57bd-4391-a194-07efeb641342', 'volume_name': 'volume-407c6a97-57bd-4391-a194-07efeb641342', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180f2ea9-19f7-4016-8906-cbba1e08688b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (180f2ea9-19f7-4016-8906-cbba1e08688b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6358ceed-29f1-4c3d-b6ce-ea6e92cd21d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:22 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Volume 407c6a97-57bd-4391-a194-07efeb641342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407c6a97-57bd-4391-a194-07efeb641342', 'volume_size': 1} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-560593064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=407c6a97-57bd-4391-a194-07efeb641342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eee8dc7f4454256b4cbd19a9419f811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:22Z,use_quota=True,user_id='1cb77dbd66f348a8b81ce77634dd2d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Creating volume 407c6a97-57bd-4391-a194-07efeb641342 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:22 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:22 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342 1073741824 Apr 22 09:24:22 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Created reservations ['2944f460-252b-4483-9861-84140b4d1f08', '3629b628-14f0-435c-af87-880c86f49bc3', 'f129406c-6fed-4b61-a44b-c3faaff8ec80', '4d7633da-b9ee-4f3b-8643-95504929d5ab'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:22 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:22 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:23 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.620s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:23 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Deleted volume successfully. Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-350830c3-75b0-4139-a0bc-4e63d62a11f8 tempest-ServersNegativeTestJSON-58459114 None] Lock "cinder-fbb7668a-1309-428d-bdb5-ea1b71d8408e-delete_volume" released by "delete_volume" :: held 1.894s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:23 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342 1073741824" returned: 0 in 0.874s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:23 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342 Apr 22 09:24:23 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Acquiring lock "cinder-8a3321a9-57f6-4200-8067-e0809dd89b91-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Lock "cinder-8a3321a9-57f6-4200-8067-e0809dd89b91-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Acquiring lock "cinder-quobyte-8a3321a9-57f6-4200-8067-e0809dd89b91" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Lock "cinder-quobyte-8a3321a9-57f6-4200-8067-e0809dd89b91" acquired by "delete_volume" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e55e70d-8898-4cde-80f7-5c07dac43f5e]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:23 devstack sudo[87149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91 Apr 22 09:24:23 devstack sudo[87149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:23 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342" returned: 0 in 0.520s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.431s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6358ceed-29f1-4c3d-b6ce-ea6e92cd21d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407c6a97-57bd-4391-a194-07efeb641342', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2aa181-414f-462e-8099-20ba68e60f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:23 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Volume volume-407c6a97-57bd-4391-a194-07efeb641342 (407c6a97-57bd-4391-a194-07efeb641342): created successfully Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c2aa181-414f-462e-8099-20ba68e60f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Flow 'volume_create_manager' (3ac28d79-e4f8-4584-8a4b-72e2ab705ff9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:23 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6e751398-2f6a-4a07-abb0-ad5bca886ff7 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Created volume successfully. Apr 22 09:24:24 devstack sudo[87149]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91" returned: 0 in 0.632s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:24 devstack sudo[87156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91 Apr 22 09:24:24 devstack sudo[87156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Acquiring lock "cinder-407c6a97-57bd-4391-a194-07efeb641342-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "cinder-407c6a97-57bd-4391-a194-07efeb641342-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Acquiring lock "cinder-quobyte-407c6a97-57bd-4391-a194-07efeb641342" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "cinder-quobyte-407c6a97-57bd-4391-a194-07efeb641342" acquired by "delete_volume" :: waited 0.017s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[044fb123-7a45-445f-998a-39edcca3229e]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:24 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342 Apr 22 09:24:24 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:24 devstack sudo[87156]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8a3321a9-57f6-4200-8067-e0809dd89b91" returned: 0 in 0.762s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Lock "cinder-quobyte-8a3321a9-57f6-4200-8067-e0809dd89b91" released by "delete_volume" :: held 1.421s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Created reservations ['46b8324f-73d7-4e1c-9a2e-8c1052077c4e', 'ed3d4ff7-d702-4fbf-8a06-b9ea0f092274', 'ccf5791e-9666-42ed-9e02-0d0570005038', '037e906f-f4d2-4167-8485-cc796bba3b40'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:25 devstack sudo[87163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:25 devstack sudo[87163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:25 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342" returned: 0 in 0.707s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:25 devstack sudo[87169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342 Apr 22 09:24:25 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:25 devstack sudo[87163]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.469s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:25 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:25 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Deleted volume successfully. Apr 22 09:24:25 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7c291e0-9eb4-4030-baf8-ff331805aeab tempest-ServersNegativeTestJSON-58459114 None] Lock "cinder-8a3321a9-57f6-4200-8067-e0809dd89b91-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:25 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-407c6a97-57bd-4391-a194-07efeb641342" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:25 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "cinder-quobyte-407c6a97-57bd-4391-a194-07efeb641342" released by "delete_volume" :: held 1.244s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:25 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-6900aaae-1d4d-49a8-8b8d-1ace48a0c0bd tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Terminate volume connection completed successfully. Apr 22 09:24:25 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-6900aaae-1d4d-49a8-8b8d-1ace48a0c0bd tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Deleting attachment d2f88efc-200f-49f1-8149-6dcb527d1fe1. {{(pid=82642) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5089}} Apr 22 09:24:25 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Created reservations ['f0b69bd7-63d6-4170-86ce-c918d6696803', '74de6a6a-8879-496d-9d95-689d7b75506a', '4e1bc274-32ac-4e94-8e46-c1442a7bb58b', 'd29a78a4-0f6e-4d6f-8d71-2d60520c76a4'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:26 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:26 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:26 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.439s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:26 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Deleted volume successfully. Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4ef07811-39c1-45e5-ba11-aacfda3b2893 tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "cinder-407c6a97-57bd-4391-a194-07efeb641342-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Flow 'volume_create_manager' (3975e4e6-d8d0-4120-9e78-bb72590ed353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe8c9b2-311d-4d3e-b010-7d9ef4888247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "cinder-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfe8c9b2-311d-4d3e-b010-7d9ef4888247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-582465733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793b8028-0b6e-440f-8860-882cb536e617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d63c74dc54346dd848529e70a9901cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:26Z,use_quota=True,user_id='6154e3fdc71a4ee393bc7091a5c2fddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bb7991-99c0-4248-9d76-529834d27ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bb7991-99c0-4248-9d76-529834d27ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c278798-d3f9-42ed-aacb-e1c27eb6e6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c278798-d3f9-42ed-aacb-e1c27eb6e6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793b8028-0b6e-440f-8860-882cb536e617', 'volume_name': 'volume-793b8028-0b6e-440f-8860-882cb536e617', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022aeff1-3efb-402f-94bb-429802ea445c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022aeff1-3efb-402f-94bb-429802ea445c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3101dd-dfd1-4098-8eb8-d3e452c90d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:26 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Volume 793b8028-0b6e-440f-8860-882cb536e617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793b8028-0b6e-440f-8860-882cb536e617', 'volume_size': 1} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-582465733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793b8028-0b6e-440f-8860-882cb536e617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d63c74dc54346dd848529e70a9901cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:26Z,use_quota=True,user_id='6154e3fdc71a4ee393bc7091a5c2fddd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Creating volume 793b8028-0b6e-440f-8860-882cb536e617 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:26 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "cinder-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:26 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 1073741824 Apr 22 09:24:26 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "cinder-quobyte-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "cinder-quobyte-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf2c2e1-12c1-4b95-b278-8210cb3d12d9]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:26 devstack sudo[87178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e Apr 22 09:24:26 devstack sudo[87178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Flow 'volume_create_manager' (9eed76fa-8b03-4946-a9ad-9d8a129a9cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a064dc-7448-44a8-a4ab-3a738a336fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:27 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a064dc-7448-44a8-a4ab-3a738a336fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1011902426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa4a03f-597a-4ad0-9230-eca88d592d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eee8dc7f4454256b4cbd19a9419f811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:27Z,use_quota=True,user_id='1cb77dbd66f348a8b81ce77634dd2d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffff102c-f490-405d-9092-25c907eeb9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffff102c-f490-405d-9092-25c907eeb9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a1f55c-f1df-4b62-9ae4-151ef974d83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a1f55c-f1df-4b62-9ae4-151ef974d83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fa4a03f-597a-4ad0-9230-eca88d592d06', 'volume_name': 'volume-3fa4a03f-597a-4ad0-9230-eca88d592d06', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1209b490-f275-4ab2-8736-e881103c0405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1209b490-f275-4ab2-8736-e881103c0405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143fc37d-95ab-4567-80d7-cb91e07a4f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:27 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Volume 3fa4a03f-597a-4ad0-9230-eca88d592d06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fa4a03f-597a-4ad0-9230-eca88d592d06', 'volume_size': 1} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 1073741824" returned: 0 in 0.841s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:27 devstack sudo[87209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 Apr 22 09:24:27 devstack sudo[87209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:27 devstack sudo[87178]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e" returned: 0 in 0.867s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:27 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e Apr 22 09:24:27 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:27 devstack sudo[87209]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617" returned: 0 in 0.476s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] <== create_volume: return (1344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.346s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1011902426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fa4a03f-597a-4ad0-9230-eca88d592d06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4eee8dc7f4454256b4cbd19a9419f811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:27Z,use_quota=True,user_id='1cb77dbd66f348a8b81ce77634dd2d53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Creating volume 3fa4a03f-597a-4ad0-9230-eca88d592d06 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:27 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3101dd-dfd1-4098-8eb8-d3e452c90d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793b8028-0b6e-440f-8860-882cb536e617', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b584f2-990e-4160-9748-26249fb5e9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:27 devstack sudo[87216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06 1073741824 Apr 22 09:24:27 devstack sudo[87216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:27 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Volume volume-793b8028-0b6e-440f-8860-882cb536e617 (793b8028-0b6e-440f-8860-882cb536e617): created successfully Apr 22 09:24:27 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3b584f2-990e-4160-9748-26249fb5e9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Flow 'volume_create_manager' (3975e4e6-d8d0-4120-9e78-bb72590ed353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e" returned: 0 in 0.466s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:27 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-718e3fe0-449f-4a4e-bd52-35ba9519aee0 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Created volume successfully. Apr 22 09:24:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "cinder-quobyte-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e" released by "delete_volume" :: held 1.359s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG cinder.quota [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Created reservations ['110d847d-4879-4a16-adde-6585ec97d882', 'cfc982dd-41c1-44aa-9ffe-bd40e88c998a', 'ac0fda68-e3a9-4fbd-86c9-654ab1dd44e0', '6b1346f4-db38-42a8-acc3-80e15aa4b3fa'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:28 devstack sudo[87218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:28 devstack sudo[87218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:28 devstack sudo[87216]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06 1073741824" returned: 0 in 0.526s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:28 devstack sudo[87225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06 Apr 22 09:24:28 devstack sudo[87225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:28 devstack sudo[87218]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.457s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG cinder.manager [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:28 devstack cinder-volume[82642]: INFO cinder.volume.manager [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Deleted volume successfully. Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG cinder.coordination [req-00ec700e-a3a2-44b0-8b74-e1dd04337d41 req-60beb7b6-3014-416c-bcf2-c10bbc2368c0 tempest-ServerBootFromVolumeStableRescueTest-456938527 None] Lock "cinder-ec5a0d6c-6d5a-4c73-b2c1-847d1c899f8e-delete_volume" released by "delete_volume" :: held 1.955s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:28 devstack sudo[87225]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06" returned: 0 in 0.518s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.186s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Creating offline snapshot 99612af1-2b44-441b-8c21-dba03e7a7960 of volume 793b8028-0b6e-440f-8860-882cb536e617 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:24:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (143fc37d-95ab-4567-80d7-cb91e07a4f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fa4a03f-597a-4ad0-9230-eca88d592d06', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4010a08d-f581-42a7-b2f8-94e6edbb82eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:29 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[22228b91-7dd2-49d8-a48a-5458fd22b272]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:29 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Volume volume-3fa4a03f-597a-4ad0-9230-eca88d592d06 (3fa4a03f-597a-4ad0-9230-eca88d592d06): created successfully Apr 22 09:24:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4010a08d-f581-42a7-b2f8-94e6edbb82eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Flow 'volume_create_manager' (9eed76fa-8b03-4946-a9ad-9d8a129a9cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:29 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-88f1a5ca-47bd-4982-93de-73456450ae5f tempest-VolumeQuotasAdminTestJSON-1886528745 None] Created volume successfully. Apr 22 09:24:29 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 Apr 22 09:24:29 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:29 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617" returned: 0 in 0.596s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:29 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 1G Apr 22 09:24:29 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:29 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=154,cinder:INSERT=50,cinder:UPDATE=165,cinder:DELETE=12 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:24:29 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-dd0b7f28-9d13-42ac-96b2-948578123011 tempest-VolumeQuotasAdminTestJSON-78907155 None] Transfer volume completed successfully. Apr 22 09:24:30 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 1G" returned: 0 in 0.542s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793b8028-0b6e-440f-8860-882cb536e617 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:30 devstack sudo[87240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793b8028-0b6e-440f-8860-882cb536e617 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 Apr 22 09:24:30 devstack sudo[87240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:30 devstack sudo[87240]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793b8028-0b6e-440f-8860-882cb536e617 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960" returned: 0 in 0.512s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:30 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 is being set with open permissions: ugo+rw Apr 22 09:24:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:30 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 Apr 22 09:24:30 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Acquiring lock "cinder-3fa4a03f-597a-4ad0-9230-eca88d592d06-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Lock "cinder-3fa4a03f-597a-4ad0-9230-eca88d592d06-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:30 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=143,cinder:UPDATE=158,cinder:INSERT=31,cinder:DELETE=6 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:24:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Acquiring lock "cinder-quobyte-3fa4a03f-597a-4ad0-9230-eca88d592d06" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Lock "cinder-quobyte-3fa4a03f-597a-4ad0-9230-eca88d592d06" acquired by "delete_volume" :: waited 0.019s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:30 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d9ad42-f0b1-4824-bb18-21864c1e15ed]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:30 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06 Apr 22 09:24:30 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:31 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960" returned: 0 in 0.615s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:31 devstack sudo[87290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.info Apr 22 09:24:31 devstack sudo[87290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:31 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06" returned: 0 in 0.600s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:31 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06 Apr 22 09:24:31 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:31 devstack sudo[87290]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.info" returned: 0 in 0.474s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:31 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.info is being set with open permissions: ugo+rw Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:31 devstack sudo[87297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.info Apr 22 09:24:31 devstack sudo[87297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:31 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3fa4a03f-597a-4ad0-9230-eca88d592d06" returned: 0 in 0.417s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Lock "cinder-quobyte-3fa4a03f-597a-4ad0-9230-eca88d592d06" released by "delete_volume" :: held 1.089s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Created reservations ['31678e23-f0ed-4433-bfe9-d21aaccff33b', '8cfecda7-2181-4865-ab00-19542fe930d0', '132ab91e-ab0a-4ff2-bd26-23596f40c1c3', '547bd08d-5969-48ba-97e3-fe61b8f7b774'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:31 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:31 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:32 devstack sudo[87297]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.info" returned: 0 in 0.513s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.338s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:32 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-028965f2-ed95-45c3-878e-73a0f1f8ec7e tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Create snapshot completed successfully Apr 22 09:24:32 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.525s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:32 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:32 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Deleted volume successfully. Apr 22 09:24:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-262b146b-61db-4b9d-9973-941f1c3f8090 tempest-VolumeQuotasAdminTestJSON-526485516 None] Lock "cinder-3fa4a03f-597a-4ad0-9230-eca88d592d06-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Acquiring lock "cinder-99612af1-2b44-441b-8c21-dba03e7a7960-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "cinder-99612af1-2b44-441b-8c21-dba03e7a7960-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Acquiring lock "cinder-quobyte-793b8028-0b6e-440f-8860-882cb536e617" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "cinder-quobyte-793b8028-0b6e-440f-8860-882cb536e617" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Acquiring lock "cinder-quobyte-99612af1-2b44-441b-8c21-dba03e7a7960" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "cinder-quobyte-99612af1-2b44-441b-8c21-dba03e7a7960" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Deleting offline snapshot 99612af1-2b44-441b-8c21-dba03e7a7960 of volume 793b8028-0b6e-440f-8860-882cb536e617 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] snapshot_file for this snap is: volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e452221-b3bd-4367-a335-796b6d70302d]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:33 devstack sudo[87311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 Apr 22 09:24:33 devstack sudo[87311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:33 devstack sudo[87311]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960" returned: 0 in 0.566s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-793b8028-0b6e-440f-8860-882cb536e617(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[360e7c88-7879-4aec-a086-5aad1b536095]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:34 devstack sudo[87317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 Apr 22 09:24:34 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:34 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617" returned: 0 in 0.558s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:34 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 Apr 22 09:24:34 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:35 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960" returned: 0 in 0.575s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:35 devstack sudo[87328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960 Apr 22 09:24:35 devstack sudo[87328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:35 devstack sudo[87328]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617.99612af1-2b44-441b-8c21-dba03e7a7960" returned: 0 in 0.532s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "cinder-quobyte-99612af1-2b44-441b-8c21-dba03e7a7960" released by "_delete_snapshot" :: held 2.309s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "cinder-quobyte-793b8028-0b6e-440f-8860-882cb536e617" released by "delete_snapshot" :: held 2.326s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:35 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Created reservations ['53d08f02-553b-41ff-b2e9-3edff92da453', 'e9443124-ae0d-4c84-b34f-7f31e50f30c8', '5d3e8201-077a-4aa5-b77c-984c36411d75', '6b730374-bb94-44a6-8ec4-45dab688de68'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:35 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Delete snapshot completed successfully. Apr 22 09:24:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3aaa756f-a224-4a3c-b1d1-6e64a4418ec7 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "cinder-99612af1-2b44-441b-8c21-dba03e7a7960-delete_snapshot" released by "delete_snapshot" :: held 2.429s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:36 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Acquiring lock "cinder-793b8028-0b6e-440f-8860-882cb536e617-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:36 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "cinder-793b8028-0b6e-440f-8860-882cb536e617-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:36 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Acquiring lock "cinder-quobyte-793b8028-0b6e-440f-8860-882cb536e617" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:36 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "cinder-quobyte-793b8028-0b6e-440f-8860-882cb536e617" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:36 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[25089c2a-ea7b-4cb6-92a8-7bc06a4e3feb]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:36 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 Apr 22 09:24:36 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:37 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617" returned: 0 in 0.664s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:37 devstack sudo[87368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617 Apr 22 09:24:37 devstack sudo[87368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:37 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Flow 'volume_create_manager' (1d9fde7f-c673-4b12-af0c-c9576b2c4514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21c18de-f83d-449d-af48-7fe56d4174f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:37 devstack sudo[87368]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-793b8028-0b6e-440f-8860-882cb536e617" returned: 0 in 0.625s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f21c18de-f83d-449d-af48-7fe56d4174f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1000257572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16279ec-42f2-48e9-8d0b-432eda3a5b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5a2e7cab03433399e512236c1198d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:38Z,use_quota=True,user_id='5ed5bb105296431d80194572e8d57cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f21403c-cf5e-45e5-a361-818329ead0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f21403c-cf5e-45e5-a361-818329ead0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3ad395-9e91-4c76-8c48-2200cd283179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c3ad395-9e91-4c76-8c48-2200cd283179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16279ec-42f2-48e9-8d0b-432eda3a5b16', 'volume_name': 'volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18c2750-94cf-4766-aa2a-031e02ecc40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a18c2750-94cf-4766-aa2a-031e02ecc40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da07a7be-9069-4b8f-9769-7801bc9b71d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:38 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Volume b16279ec-42f2-48e9-8d0b-432eda3a5b16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16', 'volume_size': 1} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1000257572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16279ec-42f2-48e9-8d0b-432eda3a5b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5a2e7cab03433399e512236c1198d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:38Z,use_quota=True,user_id='5ed5bb105296431d80194572e8d57cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Creating volume b16279ec-42f2-48e9-8d0b-432eda3a5b16 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:38 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "cinder-quobyte-793b8028-0b6e-440f-8860-882cb536e617" released by "delete_volume" :: held 1.387s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:38 devstack sudo[87374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16 1073741824 Apr 22 09:24:38 devstack sudo[87374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Created reservations ['0c11d8ed-7870-4c7a-a9c9-b190ed55139f', '29b7f3ad-fb97-4aab-ae6b-2e75af6c50b4', 'bec2b605-7f3f-46f4-94f5-38c5bccdd89d', '53758b5e-6720-496d-8426-67ccf0a627ad'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:38 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:38 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:38 devstack sudo[87374]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16 1073741824" returned: 0 in 0.582s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:38 devstack sudo[87382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16 Apr 22 09:24:38 devstack sudo[87382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:38 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.606s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:38 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Deleted volume successfully. Apr 22 09:24:38 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8edcf4c7-ea6c-4d91-8858-e65a633c5fa5 tempest-VolumeSnapshotQuotasNegativeTestJSON-681540933 None] Lock "cinder-793b8028-0b6e-440f-8860-882cb536e617-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:39 devstack sudo[87382]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16" returned: 0 in 0.634s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da07a7be-9069-4b8f-9769-7801bc9b71d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed82834-1c3b-4571-9e34-d9890f984cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:39 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Volume volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16 (b16279ec-42f2-48e9-8d0b-432eda3a5b16): created successfully Apr 22 09:24:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ed82834-1c3b-4571-9e34-d9890f984cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Flow 'volume_create_manager' (1d9fde7f-c673-4b12-af0c-c9576b2c4514) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:39 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-061c34a7-04bd-4942-9d2a-a1d3162b0f50 tempest-AbsoluteLimitsTests-1176651005 None] Created volume successfully. Apr 22 09:24:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Acquiring lock "cinder-b16279ec-42f2-48e9-8d0b-432eda3a5b16-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Lock "cinder-b16279ec-42f2-48e9-8d0b-432eda3a5b16-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Acquiring lock "cinder-quobyte-b16279ec-42f2-48e9-8d0b-432eda3a5b16" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Lock "cinder-quobyte-b16279ec-42f2-48e9-8d0b-432eda3a5b16" acquired by "delete_volume" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:40 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b848acb1-49a1-4252-b87b-56c44afb495f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:40 devstack sudo[87386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16 Apr 22 09:24:40 devstack sudo[87386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:40 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-9a6b9012-68f7-4363-bfbd-2e6530305232 tempest-GroupsTest-1117150674 None] Group tempest-Group1-1871367971: creating Apr 22 09:24:40 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-9a6b9012-68f7-4363-bfbd-2e6530305232 tempest-GroupsTest-1117150674 None] Group tempest-Group1-1871367971: created successfully Apr 22 09:24:40 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-9a6b9012-68f7-4363-bfbd-2e6530305232 tempest-GroupsTest-1117150674 None] Create group completed successfully. Apr 22 09:24:40 devstack sudo[87386]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16" returned: 0 in 0.599s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:40 devstack sudo[87391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16 Apr 22 09:24:40 devstack sudo[87391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:41 devstack sudo[87391]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b16279ec-42f2-48e9-8d0b-432eda3a5b16" returned: 0 in 0.503s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Lock "cinder-quobyte-b16279ec-42f2-48e9-8d0b-432eda3a5b16" released by "delete_volume" :: held 1.139s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Created reservations ['8f58dd26-0684-49d5-8167-2d7281956e78', '9e013f32-0fb7-4b47-a149-5ee47df96176', '3e6c1635-4b28-49e4-ad93-2cf141f1201a', 'd334f9ea-2f3e-48c4-83e3-9f37f8fe9f1a'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:41 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:41 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:41 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d2d0b06d-9837-46cc-9255-e2789ef3ba4e tempest-GroupsTest-1117150674 None] Group tempest-Group2-1549820386: creating Apr 22 09:24:41 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d2d0b06d-9837-46cc-9255-e2789ef3ba4e tempest-GroupsTest-1117150674 None] Group tempest-Group2-1549820386: created successfully Apr 22 09:24:41 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d2d0b06d-9837-46cc-9255-e2789ef3ba4e tempest-GroupsTest-1117150674 None] Create group completed successfully. Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Flow 'volume_create_manager' (1c73a927-25fe-4e49-9220-1fbd5c210787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dd695d-65ef-4041-8005-a7f87436a443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38dd695d-65ef-4041-8005-a7f87436a443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-381941612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78918a88-70fc-438c-bddb-5705e63973d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58ac384e5bb485683fa6996e692f35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:42Z,use_quota=True,user_id='8d189b9e8c7142b7baec2def76b3d94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970a3ddd-5cbf-4092-b7ec-fea906b86689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (970a3ddd-5cbf-4092-b7ec-fea906b86689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19045d8-cd99-4cda-9b0a-f72d6274338f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d19045d8-cd99-4cda-9b0a-f72d6274338f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78918a88-70fc-438c-bddb-5705e63973d8', 'volume_name': 'volume-78918a88-70fc-438c-bddb-5705e63973d8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3f6439-42b9-4f7e-83e3-2313319a49df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa3f6439-42b9-4f7e-83e3-2313319a49df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa6550d-7af3-4491-be4e-70677a19cd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:41 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Volume 78918a88-70fc-438c-bddb-5705e63973d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78918a88-70fc-438c-bddb-5705e63973d8', 'volume_size': 1} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-381941612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78918a88-70fc-438c-bddb-5705e63973d8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58ac384e5bb485683fa6996e692f35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:42Z,use_quota=True,user_id='8d189b9e8c7142b7baec2def76b3d94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Creating volume 78918a88-70fc-438c-bddb-5705e63973d8 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:41 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:41 devstack sudo[87397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8 1073741824 Apr 22 09:24:41 devstack sudo[87397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:42 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.542s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:42 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Deleted volume successfully. Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24573e80-1f0a-481d-bc86-d4a7656cf03c tempest-AbsoluteLimitsTests-1176651005 None] Lock "cinder-b16279ec-42f2-48e9-8d0b-432eda3a5b16-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Flow 'volume_create_manager' (d96b9517-4fa1-47a3-9aea-e442780089c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ffc1ed-1a10-4dce-b13d-e9631b2bffd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6ffc1ed-1a10-4dce-b13d-e9631b2bffd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-956657993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3015a893-f12d-4a38-891a-9b6b902ee365,host='devstack@QuobyteHD#QuobyteHD',id=464c6703-c51e-4dab-82cc-614ad3e5fc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b32fa7050949bfbd4281cf7eec6290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:42Z,use_quota=True,user_id='550e2caa265e47e4b331ecaa5688a2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52f15a18-c8b3-40a4-92b1-b94ddd465b14),volume_type_id=52f15a18-c8b3-40a4-92b1-b94ddd465b14)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b9bc4f-77a9-461d-bd1e-2ec7f3f371e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8b9bc4f-77a9-461d-bd1e-2ec7f3f371e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911bd7f5-9ce8-4d58-ab47-510c7a63d694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (911bd7f5-9ce8-4d58-ab47-510c7a63d694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '464c6703-c51e-4dab-82cc-614ad3e5fc2d', 'volume_name': 'volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ef9793-6156-4b88-b0f1-1d0dd94b2304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ef9793-6156-4b88-b0f1-1d0dd94b2304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d241d59c-a640-4a6a-b786-2bf2b515fcf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:42 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Volume 464c6703-c51e-4dab-82cc-614ad3e5fc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d', 'volume_size': 1} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:42 devstack sudo[87397]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8 1073741824" returned: 0 in 0.652s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:42 devstack sudo[87403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8 Apr 22 09:24:42 devstack sudo[87403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:43 devstack sudo[87403]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8" returned: 0 in 0.486s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3015a893-f12d-4a38-891a-9b6b902ee365,created_at=2026-04-22T07:24:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-956657993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3015a893-f12d-4a38-891a-9b6b902ee365,host='devstack@QuobyteHD#QuobyteHD',id=464c6703-c51e-4dab-82cc-614ad3e5fc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b32fa7050949bfbd4281cf7eec6290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:42Z,use_quota=True,user_id='550e2caa265e47e4b331ecaa5688a2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(52f15a18-c8b3-40a4-92b1-b94ddd465b14),volume_type_id=52f15a18-c8b3-40a4-92b1-b94ddd465b14)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Creating volume 464c6703-c51e-4dab-82cc-614ad3e5fc2d {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:43 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caa6550d-7af3-4491-be4e-70677a19cd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78918a88-70fc-438c-bddb-5705e63973d8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:43 devstack sudo[87406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d 1073741824 Apr 22 09:24:43 devstack sudo[87406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f459f8-a8df-45fb-b1d2-9b1fe16ebb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:43 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Volume volume-78918a88-70fc-438c-bddb-5705e63973d8 (78918a88-70fc-438c-bddb-5705e63973d8): created successfully Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72f459f8-a8df-45fb-b1d2-9b1fe16ebb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Flow 'volume_create_manager' (1c73a927-25fe-4e49-9220-1fbd5c210787) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:43 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-98ddba3c-3f5b-47bc-85de-63705ca057ff tempest-VolumesTestJSON-557709248 None] Created volume successfully. Apr 22 09:24:43 devstack sudo[87406]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d 1073741824" returned: 0 in 0.597s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:43 devstack sudo[87412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d Apr 22 09:24:43 devstack sudo[87412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:44 devstack sudo[87412]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d" returned: 0 in 0.632s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.256s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Flow 'volume_create_manager' (0e19940d-b657-45b0-b78b-8fc6048a174a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae6acad-c533-421b-8710-c7a234673566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d241d59c-a640-4a6a-b786-2bf2b515fcf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05fd6d7-76b8-44f7-98b6-eb4ec7ed7b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae6acad-c533-421b-8710-c7a234673566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1181155128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd9ff30-3b69-4cbf-9c78-8affb1a7da01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58ac384e5bb485683fa6996e692f35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:44Z,use_quota=True,user_id='8d189b9e8c7142b7baec2def76b3d94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36eee02-eb1e-4e5d-8563-3017528bb918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36eee02-eb1e-4e5d-8563-3017528bb918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038ff689-76b0-45f5-866a-2fd86196612f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (038ff689-76b0-45f5-866a-2fd86196612f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd9ff30-3b69-4cbf-9c78-8affb1a7da01', 'volume_name': 'volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c80db61-722d-4368-9563-6282b8d357d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c80db61-722d-4368-9563-6282b8d357d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2183727d-708c-43f6-b38c-1feb84207be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:44 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Volume 6bd9ff30-3b69-4cbf-9c78-8affb1a7da01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01', 'volume_size': 1} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1181155128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd9ff30-3b69-4cbf-9c78-8affb1a7da01,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58ac384e5bb485683fa6996e692f35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:44Z,use_quota=True,user_id='8d189b9e8c7142b7baec2def76b3d94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Creating volume 6bd9ff30-3b69-4cbf-9c78-8affb1a7da01 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:44 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:44 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Volume volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d (464c6703-c51e-4dab-82cc-614ad3e5fc2d): created successfully Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b05fd6d7-76b8-44f7-98b6-eb4ec7ed7b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:44 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01 1073741824 Apr 22 09:24:44 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:44 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Flow 'volume_create_manager' (d96b9517-4fa1-47a3-9aea-e442780089c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:44 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-670dfe5e-2c83-469e-b0cc-ae23d7510361 tempest-GroupsTest-1117150674 None] Created volume successfully. Apr 22 09:24:45 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01 1073741824" returned: 0 in 0.578s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:45 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01 Apr 22 09:24:45 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Flow 'volume_create_manager' (659dc164-f27b-4a9e-878b-6de68c158a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85552c15-246a-48d9-aaaf-369b266edba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85552c15-246a-48d9-aaaf-369b266edba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-413897955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3459e9f-2e3f-4732-8f9d-c6abc4d66162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e341bfe28e54c3abc8a1bac302c0cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:45Z,use_quota=True,user_id='c2ff49a1716542c593dd172438b81f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed6b381-6968-478b-a25b-80f7921f1e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ed6b381-6968-478b-a25b-80f7921f1e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c10874-1d31-4e2c-89a5-406c55f26d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c10874-1d31-4e2c-89a5-406c55f26d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3459e9f-2e3f-4732-8f9d-c6abc4d66162', 'volume_name': 'volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03e8373-ba31-4284-9bd9-fd23a9b36946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c03e8373-ba31-4284-9bd9-fd23a9b36946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dd91de-5067-4981-b160-6d0835d8fbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:45 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Volume e3459e9f-2e3f-4732-8f9d-c6abc4d66162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162', 'volume_size': 1} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:45 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01" returned: 0 in 0.488s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.133s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-413897955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3459e9f-2e3f-4732-8f9d-c6abc4d66162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e341bfe28e54c3abc8a1bac302c0cc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:45Z,use_quota=True,user_id='c2ff49a1716542c593dd172438b81f5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Creating volume e3459e9f-2e3f-4732-8f9d-c6abc4d66162 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:45 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2183727d-708c-43f6-b38c-1feb84207be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:45 devstack sudo[87423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162 1073741824 Apr 22 09:24:45 devstack sudo[87423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f43fa74-2c49-4dcf-8884-9692fd6bc62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:45 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Volume volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01 (6bd9ff30-3b69-4cbf-9c78-8affb1a7da01): created successfully Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f43fa74-2c49-4dcf-8884-9692fd6bc62d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Flow 'volume_create_manager' (0e19940d-b657-45b0-b78b-8fc6048a174a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:45 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-61d782a4-2d31-4f9c-a5c2-9133d4d4932e tempest-VolumesTestJSON-557709248 None] Created volume successfully. Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Flow 'volume_create_manager' (a6b29912-99ec-4ebb-94c9-5fcf859aff4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4cacba0-9d26-4367-97d7-ddfb3f1f9029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4cacba0-9d26-4367-97d7-ddfb3f1f9029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1593203293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448aa027-aae4-463d-9427-3ec31db95a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4ebc4b5c6d4815af9d12da7739959b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:46Z,use_quota=True,user_id='1da7907b4ba24b7c951aff9049b1bf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284f0c8b-ad75-4a20-88df-e6b5ae84c24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (284f0c8b-ad75-4a20-88df-e6b5ae84c24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2cc654-f558-4e2d-94d6-b3c45fe97c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b2cc654-f558-4e2d-94d6-b3c45fe97c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448aa027-aae4-463d-9427-3ec31db95a04', 'volume_name': 'volume-448aa027-aae4-463d-9427-3ec31db95a04', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ede5500-75a5-4164-9bd6-dc909f616357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ede5500-75a5-4164-9bd6-dc909f616357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9860bea-a7f1-4217-93c4-829b6c26f3cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:45 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Volume 448aa027-aae4-463d-9427-3ec31db95a04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448aa027-aae4-463d-9427-3ec31db95a04', 'volume_size': 1} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Acquiring lock "cinder-quobyte-464c6703-c51e-4dab-82cc-614ad3e5fc2d" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Lock "cinder-quobyte-464c6703-c51e-4dab-82cc-614ad3e5fc2d" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8188d559-41a7-4d0a-80ba-27e521da878c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:45 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d Apr 22 09:24:45 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:46 devstack sudo[87423]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162 1073741824" returned: 0 in 0.557s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:46 devstack sudo[87430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162 Apr 22 09:24:46 devstack sudo[87430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:46 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d" returned: 0 in 0.505s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:46 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d Apr 22 09:24:46 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:46 devstack sudo[87430]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162" returned: 0 in 0.440s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.901s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1593203293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448aa027-aae4-463d-9427-3ec31db95a04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb4ebc4b5c6d4815af9d12da7739959b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:46Z,use_quota=True,user_id='1da7907b4ba24b7c951aff9049b1bf15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Creating volume 448aa027-aae4-463d-9427-3ec31db95a04 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:46 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00dd91de-5067-4981-b160-6d0835d8fbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f77c81c-617b-40f0-a800-9ec5fb1ab0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:46 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 1073741824 Apr 22 09:24:46 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:46 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Volume volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162 (e3459e9f-2e3f-4732-8f9d-c6abc4d66162): created successfully Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f77c81c-617b-40f0-a800-9ec5fb1ab0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Flow 'volume_create_manager' (659dc164-f27b-4a9e-878b-6de68c158a9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:46 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-02816bb6-41a2-4dd2-b058-7c32b7354868 tempest-VolumesMetadataTest-1606201944 None] Created volume successfully. Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Flow 'volume_create_manager' (b6f9486b-383b-4581-847c-ba7a90a516f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761222c8-7d10-47d4-98e7-a71d3b9ee88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:46 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761222c8-7d10-47d4-98e7-a71d3b9ee88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1114602284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5230485c-9d53-4718-853f-12b43fc4d6d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58ac384e5bb485683fa6996e692f35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:47Z,use_quota=True,user_id='8d189b9e8c7142b7baec2def76b3d94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16da1248-703a-4daf-b369-1f5b7c2b466f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16da1248-703a-4daf-b369-1f5b7c2b466f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76582eb0-cbac-43a3-9bc8-01610731e7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76582eb0-cbac-43a3-9bc8-01610731e7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5230485c-9d53-4718-853f-12b43fc4d6d1', 'volume_name': 'volume-5230485c-9d53-4718-853f-12b43fc4d6d1', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (115a0fc5-fdc9-48f2-8733-52b674d1deee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (115a0fc5-fdc9-48f2-8733-52b674d1deee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e21725f-de03-4ec5-9d48-6b6fdff73c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:46 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Volume 5230485c-9d53-4718-853f-12b43fc4d6d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5230485c-9d53-4718-853f-12b43fc4d6d1', 'volume_size': 1} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-464c6703-c51e-4dab-82cc-614ad3e5fc2d" returned: 0 in 0.509s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Lock "cinder-quobyte-464c6703-c51e-4dab-82cc-614ad3e5fc2d" released by "delete_volume" :: held 1.038s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Created reservations ['4311dfac-8a19-4ef0-b0fe-7264e84c5eb6'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:46 devstack cinder-volume[82642]: WARNING cinder.quota [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-532857254 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-532857254, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:24:46 devstack cinder-volume[82642]: WARNING cinder.quota [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-532857254 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-532857254, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:24:46 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Created reservations ['0dba1a95-dbf8-4b07-b60c-53fb86a674f8', '598aca5d-9455-404b-a06e-12387f6cb629', 'f1df4dd3-8917-440b-bdf3-3a7d8d79f35d', 'eb6eacd9-3a86-41f3-8409-b6015b5decd5'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:47 devstack sudo[87444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:47 devstack sudo[87444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:47 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 1073741824" returned: 0 in 0.572s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:47 devstack sudo[87447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 Apr 22 09:24:47 devstack sudo[87447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:47 devstack sudo[87444]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.464s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:47 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-bf67cee3-eaf9-4892-8ff5-7c337f08197f tempest-GroupsTest-1117150674 None] Delete group completed successfully. Apr 22 09:24:47 devstack sudo[87447]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04" returned: 0 in 0.428s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1114602284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5230485c-9d53-4718-853f-12b43fc4d6d1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='b58ac384e5bb485683fa6996e692f35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:47Z,use_quota=True,user_id='8d189b9e8c7142b7baec2def76b3d94e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Creating volume 5230485c-9d53-4718-853f-12b43fc4d6d1 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:47 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9860bea-a7f1-4217-93c4-829b6c26f3cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448aa027-aae4-463d-9427-3ec31db95a04', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:47 devstack sudo[87451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1 1073741824 Apr 22 09:24:47 devstack sudo[87451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047bd84b-3a30-4e82-b777-ae8f668b2741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:47 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Volume volume-448aa027-aae4-463d-9427-3ec31db95a04 (448aa027-aae4-463d-9427-3ec31db95a04): created successfully Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (047bd84b-3a30-4e82-b777-ae8f668b2741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Flow 'volume_create_manager' (a6b29912-99ec-4ebb-94c9-5fcf859aff4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:47 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e0617e20-b5f4-434d-a037-2551b26e68ab tempest-SnapshotMetadataTestJSON-1214162643 None] Created volume successfully. Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Acquiring lock "cinder-e3459e9f-2e3f-4732-8f9d-c6abc4d66162-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Lock "cinder-e3459e9f-2e3f-4732-8f9d-c6abc4d66162-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Acquiring lock "cinder-quobyte-e3459e9f-2e3f-4732-8f9d-c6abc4d66162" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Lock "cinder-quobyte-e3459e9f-2e3f-4732-8f9d-c6abc4d66162" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6aeb43c-0daa-4915-848a-1fd3e55d118f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:48 devstack sudo[87456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162 Apr 22 09:24:48 devstack sudo[87456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-99ddd9ef-f793-4dfe-940d-2c324cc9d378 tempest-GroupsTest-1117150674 None] Created reservations ['4a6c5ae6-90fb-4e23-ad84-22d0d30fea1f'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-99ddd9ef-f793-4dfe-940d-2c324cc9d378 tempest-GroupsTest-1117150674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-99ddd9ef-f793-4dfe-940d-2c324cc9d378 tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-99ddd9ef-f793-4dfe-940d-2c324cc9d378 tempest-GroupsTest-1117150674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-99ddd9ef-f793-4dfe-940d-2c324cc9d378 tempest-GroupsTest-1117150674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-99ddd9ef-f793-4dfe-940d-2c324cc9d378 tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-99ddd9ef-f793-4dfe-940d-2c324cc9d378 tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:48 devstack sudo[87458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:48 devstack sudo[87458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:48 devstack sudo[87451]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1 1073741824" returned: 0 in 0.571s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:48 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1 Apr 22 09:24:48 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:48 devstack sudo[87458]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:48 devstack sudo[87456]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-99ddd9ef-f793-4dfe-940d-2c324cc9d378 tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.406s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-99ddd9ef-f793-4dfe-940d-2c324cc9d378 tempest-GroupsTest-1117150674 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:48 devstack sudo[87467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162 Apr 22 09:24:48 devstack sudo[87467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:48 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-99ddd9ef-f793-4dfe-940d-2c324cc9d378 tempest-GroupsTest-1117150674 None] Delete group completed successfully. Apr 22 09:24:48 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1" returned: 0 in 0.452s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e21725f-de03-4ec5-9d48-6b6fdff73c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5230485c-9d53-4718-853f-12b43fc4d6d1', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f397410e-fb4d-4e78-843e-778756a7dc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:48 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Volume volume-5230485c-9d53-4718-853f-12b43fc4d6d1 (5230485c-9d53-4718-853f-12b43fc4d6d1): created successfully Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f397410e-fb4d-4e78-843e-778756a7dc98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Flow 'volume_create_manager' (b6f9486b-383b-4581-847c-ba7a90a516f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:48 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e1e77eee-71b5-4779-a4d4-d7cbc631923e tempest-VolumesTestJSON-557709248 None] Created volume successfully. Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] Creating offline snapshot 6bc766a4-4209-498b-9166-6411cb7a0f84 of volume 448aa027-aae4-463d-9427-3ec31db95a04 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e501bab-3be6-42d6-a78c-be3b9d4730d6]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:49 devstack sudo[87467]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e3459e9f-2e3f-4732-8f9d-c6abc4d66162" returned: 0 in 0.408s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Lock "cinder-quobyte-e3459e9f-2e3f-4732-8f9d-c6abc4d66162" released by "delete_volume" :: held 0.958s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:49 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 Apr 22 09:24:49 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Created reservations ['84802ea7-e68c-41df-b629-354b8e08a99b', 'ebe7f207-ba65-4c9d-8382-73e008194b8c', '87672075-4a8b-45a4-9efe-a8e650e0877a', '33fb44e8-44dd-46e9-aac0-3a6f69093beb'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:49 devstack sudo[87472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:49 devstack sudo[87472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:49 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04" returned: 0 in 0.659s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:49 devstack sudo[87477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 1G Apr 22 09:24:49 devstack sudo[87477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:49 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-91f701c1-f4b5-4a6e-bb28-f89ecf25ccfa tempest-GroupsTest-1117150674 None] Group tempest-GroupsTest-Group-1911183937: creating Apr 22 09:24:49 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-91f701c1-f4b5-4a6e-bb28-f89ecf25ccfa tempest-GroupsTest-1117150674 None] Group tempest-GroupsTest-Group-1911183937: created successfully Apr 22 09:24:49 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-91f701c1-f4b5-4a6e-bb28-f89ecf25ccfa tempest-GroupsTest-1117150674 None] Create group completed successfully. Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Acquiring lock "cinder-5230485c-9d53-4718-853f-12b43fc4d6d1-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Lock "cinder-5230485c-9d53-4718-853f-12b43fc4d6d1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Acquiring lock "cinder-quobyte-5230485c-9d53-4718-853f-12b43fc4d6d1" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Lock "cinder-quobyte-5230485c-9d53-4718-853f-12b43fc4d6d1" acquired by "delete_volume" :: waited 0.021s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:49 devstack sudo[87472]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.804s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:49 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Deleted volume successfully. Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7cf05f9-b695-4634-a6ef-7258a6e8fcb4]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ae585d9-92d3-487d-a13c-07dfca41983e tempest-VolumesMetadataTest-1606201944 None] Lock "cinder-e3459e9f-2e3f-4732-8f9d-c6abc4d66162-delete_volume" released by "delete_volume" :: held 1.968s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:50 devstack sudo[87480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1 Apr 22 09:24:50 devstack sudo[87480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:50 devstack sudo[87477]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 1G" returned: 0 in 0.632s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-448aa027-aae4-463d-9427-3ec31db95a04 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:50 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-448aa027-aae4-463d-9427-3ec31db95a04 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 Apr 22 09:24:50 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:50 devstack sudo[87480]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1" returned: 0 in 0.540s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:50 devstack sudo[87490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1 Apr 22 09:24:50 devstack sudo[87490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:50 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-448aa027-aae4-463d-9427-3ec31db95a04 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84" returned: 0 in 0.498s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:50 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 is being set with open permissions: ugo+rw Apr 22 09:24:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:50 devstack sudo[87495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 Apr 22 09:24:50 devstack sudo[87495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:51 devstack sudo[87490]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5230485c-9d53-4718-853f-12b43fc4d6d1" returned: 0 in 0.606s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Lock "cinder-quobyte-5230485c-9d53-4718-853f-12b43fc4d6d1" released by "delete_volume" :: held 1.205s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Flow 'volume_create_manager' (5dbb6875-6809-4862-bb65-d7b7d1506ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ddd100-d499-4ed4-acc3-2e03115caaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Created reservations ['bb4c09bc-ca7b-4bb8-a0ce-32e9a9cc2196', '0d5300fa-b37a-4384-b996-4f0afd6c66a4', '5a998be8-adac-4fa6-a826-d81001e133bc', '004a56dd-b217-4950-add3-f80cdf1ff1f4'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:51 devstack sudo[87495]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75ddd100-d499-4ed4-acc3-2e03115caaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907155486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0cbdba2-16dd-406e-b32f-6c9c63b612bc,host='devstack@QuobyteHD#QuobyteHD',id=9c3c63a6-3aea-4909-9630-19b26b03ff73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b32fa7050949bfbd4281cf7eec6290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:51Z,use_quota=True,user_id='550e2caa265e47e4b331ecaa5688a2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05cf1821-b990-427e-9a1e-1cbe54837b5c),volume_type_id=05cf1821-b990-427e-9a1e-1cbe54837b5c)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76830655-6428-4713-a588-b83e6fd44571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76830655-6428-4713-a588-b83e6fd44571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf03fa3-2f7c-4ed0-9cef-34b91e96f929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bf03fa3-2f7c-4ed0-9cef-34b91e96f929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c3c63a6-3aea-4909-9630-19b26b03ff73', 'volume_name': 'volume-9c3c63a6-3aea-4909-9630-19b26b03ff73', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e2a86c-72cd-44e3-8b23-964650105f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02e2a86c-72cd-44e3-8b23-964650105f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed196076-e230-4f5e-843b-fbe237f6e51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:51 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Volume 9c3c63a6-3aea-4909-9630-19b26b03ff73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c3c63a6-3aea-4909-9630-19b26b03ff73', 'volume_size': 1} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84" returned: 0 in 0.530s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:51 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.info Apr 22 09:24:51 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:51 devstack sudo[87502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:51 devstack sudo[87502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:51 devstack sudo[87502]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.442s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:51 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Deleted volume successfully. Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-175f9779-297c-4b13-845e-a8d7ed6dd1fe tempest-VolumesTestJSON-557709248 None] Lock "cinder-5230485c-9d53-4718-853f-12b43fc4d6d1-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:51 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.info" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:51 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.info is being set with open permissions: ugo+rw Apr 22 09:24:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:51 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.info Apr 22 09:24:51 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Acquiring lock "cinder-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Lock "cinder-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Acquiring lock "cinder-quobyte-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Lock "cinder-quobyte-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:52 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.info" returned: 0 in 0.417s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.336s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0aabe3a-2a7c-441d-b2fa-ef9bfaf8f1ca]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d0cbdba2-16dd-406e-b32f-6c9c63b612bc,created_at=2026-04-22T07:24:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-907155486',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0cbdba2-16dd-406e-b32f-6c9c63b612bc,host='devstack@QuobyteHD#QuobyteHD',id=9c3c63a6-3aea-4909-9630-19b26b03ff73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b32fa7050949bfbd4281cf7eec6290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:51Z,use_quota=True,user_id='550e2caa265e47e4b331ecaa5688a2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05cf1821-b990-427e-9a1e-1cbe54837b5c),volume_type_id=05cf1821-b990-427e-9a1e-1cbe54837b5c)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Creating volume 9c3c63a6-3aea-4909-9630-19b26b03ff73 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:52 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:52 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73 1073741824 Apr 22 09:24:52 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:52 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7ebfd840-f14d-4ca7-ade1-39df24058af8 tempest-SnapshotMetadataTestJSON-1214162643 None] Create snapshot completed successfully Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Flow 'volume_create_manager' (3158b10c-9eb0-42eb-ae4e-302d5f5c7919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda5dcff-a748-4f1c-96d9-f8eac2b11fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:52 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01 Apr 22 09:24:52 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fda5dcff-a748-4f1c-96d9-f8eac2b11fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-266204715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0843576-d1dc-4709-ae75-0db3b3c40e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02576de8780842ed9306c440c54a787e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:52Z,use_quota=True,user_id='dba91fdaaf1642eeb2a44cbb60011eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acce80ef-d1b8-415f-9a8d-307552fcea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acce80ef-d1b8-415f-9a8d-307552fcea59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0566d8-88c8-428e-b38a-354f038cd7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af0566d8-88c8-428e-b38a-354f038cd7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0843576-d1dc-4709-ae75-0db3b3c40e01', 'volume_name': 'volume-a0843576-d1dc-4709-ae75-0db3b3c40e01', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2b2da1-206a-4693-8d32-47607bf37f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af2b2da1-206a-4693-8d32-47607bf37f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cd1614-1859-4798-9d31-281bc16f370b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:52 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Volume a0843576-d1dc-4709-ae75-0db3b3c40e01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0843576-d1dc-4709-ae75-0db3b3c40e01', 'volume_size': 1} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:52 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73 1073741824" returned: 0 in 0.469s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:52 devstack sudo[87519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73 Apr 22 09:24:52 devstack sudo[87519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:52 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:52 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01 Apr 22 09:24:52 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:53 devstack sudo[87519]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73" returned: 0 in 0.473s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.818s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-266204715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0843576-d1dc-4709-ae75-0db3b3c40e01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02576de8780842ed9306c440c54a787e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:52Z,use_quota=True,user_id='dba91fdaaf1642eeb2a44cbb60011eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Creating volume a0843576-d1dc-4709-ae75-0db3b3c40e01 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:53 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:53 devstack sudo[87525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01 1073741824 Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed196076-e230-4f5e-843b-fbe237f6e51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c3c63a6-3aea-4909-9630-19b26b03ff73', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:53 devstack sudo[87525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:53 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334fcd80-eceb-48c9-8e74-6579d0e94b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01" returned: 0 in 0.479s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Lock "cinder-quobyte-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01" released by "delete_volume" :: held 1.100s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:53 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Volume volume-9c3c63a6-3aea-4909-9630-19b26b03ff73 (9c3c63a6-3aea-4909-9630-19b26b03ff73): created successfully Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (334fcd80-eceb-48c9-8e74-6579d0e94b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Flow 'volume_create_manager' (5dbb6875-6809-4862-bb65-d7b7d1506ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:53 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b45bc745-1058-4e93-9f94-61f2fff7b909 tempest-GroupsTest-1117150674 None] Created volume successfully. Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Created reservations ['96303e84-4b2c-4b7d-9c38-199afff176ec', 'f6b59518-d165-42bb-8865-fd799d4274c5', '9b2d9633-066c-4f1a-b3a8-7d9a6f359990', 'ddf96693-b9a8-49fb-826b-06cd301ff041'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:53 devstack sudo[87527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:53 devstack sudo[87527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Acquiring lock "cinder-6bc766a4-4209-498b-9166-6411cb7a0f84-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "cinder-6bc766a4-4209-498b-9166-6411cb7a0f84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Acquiring lock "cinder-quobyte-448aa027-aae4-463d-9427-3ec31db95a04" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "cinder-quobyte-448aa027-aae4-463d-9427-3ec31db95a04" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Acquiring lock "cinder-quobyte-6bc766a4-4209-498b-9166-6411cb7a0f84" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "cinder-quobyte-6bc766a4-4209-498b-9166-6411cb7a0f84" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Deleting offline snapshot 6bc766a4-4209-498b-9166-6411cb7a0f84 of volume 448aa027-aae4-463d-9427-3ec31db95a04 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] snapshot_file for this snap is: volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e8993f3-28e9-43e6-92df-b5a65fa3fa70]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:53 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 Apr 22 09:24:53 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:53 devstack sudo[87525]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01 1073741824" returned: 0 in 0.590s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:53 devstack sudo[87535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01 Apr 22 09:24:53 devstack sudo[87535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:53 devstack sudo[87527]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.463s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:53 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Deleted volume successfully. Apr 22 09:24:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-87a1a853-ff58-45e6-899a-2a23e4e7021b tempest-VolumesTestJSON-557709248 None] Lock "cinder-6bd9ff30-3b69-4cbf-9c78-8affb1a7da01-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:54 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84" returned: 0 in 0.524s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-448aa027-aae4-463d-9427-3ec31db95a04(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d5ac92-04e9-4953-9efe-f39aecf81c8a]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:54 devstack sudo[87535]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01" returned: 0 in 0.418s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6cd1614-1859-4798-9d31-281bc16f370b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0843576-d1dc-4709-ae75-0db3b3c40e01', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:54 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 Apr 22 09:24:54 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2986168b-9ac2-4c7c-87ff-c2469adeaa11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:54 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Volume volume-a0843576-d1dc-4709-ae75-0db3b3c40e01 (a0843576-d1dc-4709-ae75-0db3b3c40e01): created successfully Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2986168b-9ac2-4c7c-87ff-c2469adeaa11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Flow 'volume_create_manager' (3158b10c-9eb0-42eb-ae4e-302d5f5c7919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:54 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-56fea275-02e3-4f4c-99a3-02d64f96f4e5 tempest-VolumesTransfersTest-1958071772 None] Created volume successfully. Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Acquiring lock "cinder-78918a88-70fc-438c-bddb-5705e63973d8-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Lock "cinder-78918a88-70fc-438c-bddb-5705e63973d8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Acquiring lock "cinder-quobyte-78918a88-70fc-438c-bddb-5705e63973d8" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Lock "cinder-quobyte-78918a88-70fc-438c-bddb-5705e63973d8" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[defea32d-bb98-4338-9c95-1f4df6574eaa]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:54 devstack sudo[87543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8 Apr 22 09:24:54 devstack sudo[87543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:54 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Flow 'volume_create_manager' (7577de6e-6e12-42c0-9b94-5196aa0f13b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4d336a-c93a-4cd7-9add-822fb6a42683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04" returned: 0 in 0.648s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4d336a-c93a-4cd7-9add-822fb6a42683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1562914693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0cbdba2-16dd-406e-b32f-6c9c63b612bc,host='devstack@QuobyteHD#QuobyteHD',id=a6b83bda-8355-4429-ab37-6387d72bdd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b32fa7050949bfbd4281cf7eec6290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:55Z,use_quota=True,user_id='550e2caa265e47e4b331ecaa5688a2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05cf1821-b990-427e-9a1e-1cbe54837b5c),volume_type_id=05cf1821-b990-427e-9a1e-1cbe54837b5c)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a18a8f-96f4-4a7e-8ee3-4f845ff094e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83a18a8f-96f4-4a7e-8ee3-4f845ff094e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05843c4f-8e18-4393-a249-28c0f6292746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05843c4f-8e18-4393-a249-28c0f6292746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6b83bda-8355-4429-ab37-6387d72bdd06', 'volume_name': 'volume-a6b83bda-8355-4429-ab37-6387d72bdd06', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4300b720-ed18-4463-a296-b383ae145405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:54 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4300b720-ed18-4463-a296-b383ae145405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:54 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6717fb04-cfeb-49df-b07b-67ceaab69db0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:54 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Volume a6b83bda-8355-4429-ab37-6387d72bdd06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6b83bda-8355-4429-ab37-6387d72bdd06', 'volume_size': 1} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d0cbdba2-16dd-406e-b32f-6c9c63b612bc,created_at=2026-04-22T07:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1562914693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0cbdba2-16dd-406e-b32f-6c9c63b612bc,host='devstack@QuobyteHD#QuobyteHD',id=a6b83bda-8355-4429-ab37-6387d72bdd06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9b32fa7050949bfbd4281cf7eec6290',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:55Z,use_quota=True,user_id='550e2caa265e47e4b331ecaa5688a2f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05cf1821-b990-427e-9a1e-1cbe54837b5c),volume_type_id=05cf1821-b990-427e-9a1e-1cbe54837b5c)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Creating volume a6b83bda-8355-4429-ab37-6387d72bdd06 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:54 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:54 devstack sudo[87543]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8" returned: 0 in 0.515s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:54 devstack sudo[87553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06 1073741824 Apr 22 09:24:54 devstack sudo[87553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:54 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-83b9cbda-84f9-4e84-9437-0aad1a4ea02c tempest-VolumesTransfersTest-1554952924 None] Transfer volume completed successfully. Apr 22 09:24:54 devstack sudo[87555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8 Apr 22 09:24:54 devstack sudo[87555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:55 devstack sudo[87553]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06 1073741824" returned: 0 in 0.482s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:55 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84" returned: 0 in 0.548s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:55 devstack sudo[87555]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-78918a88-70fc-438c-bddb-5705e63973d8" returned: 0 in 0.474s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:55 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84 Apr 22 09:24:55 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Lock "cinder-quobyte-78918a88-70fc-438c-bddb-5705e63973d8" released by "delete_volume" :: held 1.025s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:55 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06 Apr 22 09:24:55 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Created reservations ['9f4071c9-b98e-47ec-96cb-1f42ece98a04', 'faf887ad-8bb9-4b23-b481-8b3ddc8c0006', '678dca8f-7657-4c8c-8abc-d0eca0e3a519', '84041785-d731-4c43-8154-74608654c2b3'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:55 devstack sudo[87568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:55 devstack sudo[87568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Acquiring lock "cinder-a0843576-d1dc-4709-ae75-0db3b3c40e01-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Lock "cinder-a0843576-d1dc-4709-ae75-0db3b3c40e01-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Acquiring lock "cinder-quobyte-a0843576-d1dc-4709-ae75-0db3b3c40e01" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Lock "cinder-quobyte-a0843576-d1dc-4709-ae75-0db3b3c40e01" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:55 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04.6bc766a4-4209-498b-9166-6411cb7a0f84" returned: 0 in 0.493s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b3ddee-247a-4917-a530-46062030859a]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:55 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06" returned: 0 in 0.493s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "cinder-quobyte-6bc766a4-4209-498b-9166-6411cb7a0f84" released by "_delete_snapshot" :: held 2.293s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "cinder-quobyte-448aa027-aae4-463d-9427-3ec31db95a04" released by "delete_snapshot" :: held 2.305s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6717fb04-cfeb-49df-b07b-67ceaab69db0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6b83bda-8355-4429-ab37-6387d72bdd06', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3029d7-1b23-433a-8119-0ceefad1989a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:55 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Volume volume-a6b83bda-8355-4429-ab37-6387d72bdd06 (a6b83bda-8355-4429-ab37-6387d72bdd06): created successfully Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc3029d7-1b23-433a-8119-0ceefad1989a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Flow 'volume_create_manager' (7577de6e-6e12-42c0-9b94-5196aa0f13b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:55 devstack sudo[87572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01 Apr 22 09:24:55 devstack sudo[87572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:55 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-03cc4e03-0f1d-46fa-bfed-91262c44c2fe tempest-GroupsTest-1117150674 None] Created volume successfully. Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Created reservations ['d28151ce-bc3a-49c8-9910-3586975ec874', '59ef517b-0b0b-41f6-b221-4f105c7b4029', '1549d9e7-6553-4589-94a6-3df11411a572', '22d1fc9c-bc23-4546-bafe-d7abea7150a0'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:56 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Delete snapshot completed successfully. Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-265cfc67-ccfb-45a5-b265-6197b72b5239 tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "cinder-6bc766a4-4209-498b-9166-6411cb7a0f84-delete_snapshot" released by "delete_snapshot" :: held 2.414s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:56 devstack sudo[87568]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.531s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:56 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Deleted volume successfully. Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d5abf731-0a14-4652-ba9f-e8ee4023da12 tempest-VolumesTestJSON-557709248 None] Lock "cinder-78918a88-70fc-438c-bddb-5705e63973d8-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:56 devstack sudo[87572]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01" returned: 0 in 0.505s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:56 devstack sudo[87578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01 Apr 22 09:24:56 devstack sudo[87578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Acquiring lock "cinder-448aa027-aae4-463d-9427-3ec31db95a04-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:56 devstack sudo[87578]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "cinder-448aa027-aae4-463d-9427-3ec31db95a04-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a0843576-d1dc-4709-ae75-0db3b3c40e01" returned: 0 in 0.501s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Lock "cinder-quobyte-a0843576-d1dc-4709-ae75-0db3b3c40e01" released by "delete_volume" :: held 1.054s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Acquiring lock "cinder-quobyte-448aa027-aae4-463d-9427-3ec31db95a04" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "cinder-quobyte-448aa027-aae4-463d-9427-3ec31db95a04" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[857b225a-b942-4cd5-9a53-9867faea9d35]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Created reservations ['a8b84bc4-6082-448b-a37b-8f61aa24188b', 'f8c736ce-0ffe-475b-964b-1556cc91d6ee', '9bcf69bd-05fe-474f-9122-56a8f5fee595', '9f2862e6-e6cf-4f32-ab7a-54f55992215b'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:57 devstack sudo[87581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 Apr 22 09:24:57 devstack sudo[87581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:57 devstack sudo[87583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:57 devstack sudo[87583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:57 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-19447833-4ec4-4698-8526-a008ed627ad6 tempest-GroupsTest-1117150674 None] Update group completed successfully. Apr 22 09:24:57 devstack sudo[87583]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.443s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:57 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Deleted volume successfully. Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1f74699f-2e6a-4cc5-8799-949ccd08b4d3 tempest-VolumesTransfersTest-2060225604 None] Lock "cinder-a0843576-d1dc-4709-ae75-0db3b3c40e01-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:57 devstack sudo[87581]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04" returned: 0 in 0.640s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:57 devstack sudo[87589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04 Apr 22 09:24:57 devstack sudo[87589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:58 devstack sudo[87589]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-448aa027-aae4-463d-9427-3ec31db95a04" returned: 0 in 0.474s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "cinder-quobyte-448aa027-aae4-463d-9427-3ec31db95a04" released by "delete_volume" :: held 1.156s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Created reservations ['e1385a79-ceee-4e18-9163-29360dfe383f', '155bce45-afa0-4185-83e1-e7350145a55b', 'c0c08d43-78b3-4ce1-b7a5-8e6fdf845f22', '5ac07363-c158-45e2-bad0-79bfa3d62f0f'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:58 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:24:58 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Flow 'volume_create_manager' (4b685cb2-205e-4147-abcb-4875c46ae317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62eae5a0-f475-44b7-a124-bb568237241d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62eae5a0-f475-44b7-a124-bb568237241d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-745382108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87936565-0e00-4784-bf90-91172e61f476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02576de8780842ed9306c440c54a787e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:58Z,use_quota=True,user_id='dba91fdaaf1642eeb2a44cbb60011eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9af7f57-028d-4ba4-a4fe-0e23e49514c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9af7f57-028d-4ba4-a4fe-0e23e49514c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f709f5a-4b07-4535-ad65-e14f0f5198a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f709f5a-4b07-4535-ad65-e14f0f5198a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87936565-0e00-4784-bf90-91172e61f476', 'volume_name': 'volume-87936565-0e00-4784-bf90-91172e61f476', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50105979-175c-42af-9fe9-4c48a5c47f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50105979-175c-42af-9fe9-4c48a5c47f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9a3c44-35f8-4bf7-9e28-d430756eb4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:58 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Volume 87936565-0e00-4784-bf90-91172e61f476: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87936565-0e00-4784-bf90-91172e61f476', 'volume_size': 1} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:24:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-745382108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87936565-0e00-4784-bf90-91172e61f476,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02576de8780842ed9306c440c54a787e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:24:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:24:58Z,use_quota=True,user_id='dba91fdaaf1642eeb2a44cbb60011eee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Creating volume 87936565-0e00-4784-bf90-91172e61f476 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:24:58 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:58 devstack sudo[87594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476 1073741824 Apr 22 09:24:58 devstack sudo[87594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:58 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-5e205e0e-9376-433c-9e70-2b0201d70e65 tempest-GroupsTest-1117150674 None] Update group completed successfully. Apr 22 09:24:58 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.474s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:24:58 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Deleted volume successfully. Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c1bb096-b6e8-4e3c-9487-42b70b2792bd tempest-SnapshotMetadataTestJSON-1214162643 None] Lock "cinder-448aa027-aae4-463d-9427-3ec31db95a04-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:24:58 devstack sudo[87594]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476 1073741824" returned: 0 in 0.531s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:59 devstack sudo[87600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476 Apr 22 09:24:59 devstack sudo[87600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:24:59 devstack sudo[87600]: pam_unix(sudo:session): session closed for user root Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476" returned: 0 in 0.486s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.052s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f9a3c44-35f8-4bf7-9e28-d430756eb4dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87936565-0e00-4784-bf90-91172e61f476', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8469b8d5-8f26-41af-9955-d47e39149cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:24:59 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Volume volume-87936565-0e00-4784-bf90-91172e61f476 (87936565-0e00-4784-bf90-91172e61f476): created successfully Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8469b8d5-8f26-41af-9955-d47e39149cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Flow 'volume_create_manager' (4b685cb2-205e-4147-abcb-4875c46ae317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:24:59 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d2bf974b-af17-4c0c-93d1-d1ec59461d39 tempest-VolumesTransfersTest-1958071772 None] Created volume successfully. Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Acquiring lock "cinder-quobyte-9c3c63a6-3aea-4909-9630-19b26b03ff73" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Lock "cinder-quobyte-9c3c63a6-3aea-4909-9630-19b26b03ff73" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9875992-aa14-4023-ada5-110b5114dcaf]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:24:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:24:59 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73 Apr 22 09:24:59 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:00 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73" returned: 0 in 0.644s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:00 devstack sudo[87608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73 Apr 22 09:25:00 devstack sudo[87608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Acquiring lock "cinder-87936565-0e00-4784-bf90-91172e61f476-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Lock "cinder-87936565-0e00-4784-bf90-91172e61f476-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Acquiring lock "cinder-quobyte-87936565-0e00-4784-bf90-91172e61f476" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Lock "cinder-quobyte-87936565-0e00-4784-bf90-91172e61f476" acquired by "delete_volume" :: waited 0.022s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fada0a-e742-4504-9e60-e827e71f60c8]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:00 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476 Apr 22 09:25:00 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:00 devstack sudo[87608]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9c3c63a6-3aea-4909-9630-19b26b03ff73" returned: 0 in 0.553s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Lock "cinder-quobyte-9c3c63a6-3aea-4909-9630-19b26b03ff73" released by "delete_volume" :: held 1.232s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Acquiring lock "cinder-quobyte-a6b83bda-8355-4429-ab37-6387d72bdd06" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Lock "cinder-quobyte-a6b83bda-8355-4429-ab37-6387d72bdd06" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9e8509e-62d0-41ab-ba19-8cd71161b288]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:01 devstack sudo[87613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06 Apr 22 09:25:01 devstack sudo[87613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:01 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476" returned: 0 in 0.622s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:01 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476 Apr 22 09:25:01 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:01 devstack sudo[87613]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06" returned: 0 in 0.591s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:01 devstack sudo[87624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06 Apr 22 09:25:01 devstack sudo[87624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:01 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87936565-0e00-4784-bf90-91172e61f476" returned: 0 in 0.469s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Lock "cinder-quobyte-87936565-0e00-4784-bf90-91172e61f476" released by "delete_volume" :: held 1.117s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Created reservations ['e430a0b1-bf7c-4a87-856e-d34655c33032', '5bb89e25-7cf6-45a1-b8a9-8aba2df458ea', '985062a1-5690-442a-88ee-9b162a74d7c3', 'f7292d9f-135a-4be2-93ef-91c1f21ad408'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:02 devstack sudo[87627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:02 devstack sudo[87627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:02 devstack sudo[87624]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a6b83bda-8355-4429-ab37-6387d72bdd06" returned: 0 in 0.503s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Lock "cinder-quobyte-a6b83bda-8355-4429-ab37-6387d72bdd06" released by "delete_volume" :: held 1.120s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Created reservations ['e602350f-37ea-4da5-8aa4-7d81d4327166'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:02 devstack cinder-volume[82642]: WARNING cinder.quota [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1824751579 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1824751579, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:25:02 devstack cinder-volume[82642]: WARNING cinder.quota [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1824751579 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1824751579, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Created reservations ['4a2e0f28-6702-4e80-af41-f41b9f577b93', '9a3e1f7f-4fe7-41a7-a0ec-3854be775ad3', 'e7d1ea25-fcde-4eb3-970c-46c6a72f1fa5', '55215eff-e9f9-4c72-95e0-244f036ad286'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Created reservations ['92e72b51-2c82-4c3a-b54e-e387f46a9c7f', '1a503c71-beaa-4853-8b12-82c855168afa', 'ba64f1a2-3ed5-4d41-b7f5-4802feca273b', '4c82a1ea-80d7-43ef-a85b-eb453c1f74e3'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:02 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:02 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:02 devstack sudo[87627]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.589s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:02 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Deleted volume successfully. Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-606bad25-4336-4219-9a0e-8b48b71f9737 tempest-VolumesTransfersTest-2060225604 None] Lock "cinder-87936565-0e00-4784-bf90-91172e61f476-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Flow 'volume_create_manager' (e5f28b02-7b26-4013-b533-c82021e98138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eea5fcd-8bff-4ecb-8b00-3d1de38cfb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5eea5fcd-8bff-4ecb-8b00-3d1de38cfb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1823936715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ab034ba5314753a523ebbb57a48f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:03Z,use_quota=True,user_id='afc2b397555d49f5a39158aa73196039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23482060-e51c-4668-b76b-f8b2e8637e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23482060-e51c-4668-b76b-f8b2e8637e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80a8297-e215-4822-81a2-de13433fc6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e80a8297-e215-4822-81a2-de13433fc6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68', 'volume_name': 'volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7d45e4-53ae-4325-94d7-c13fcd68576d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b7d45e4-53ae-4325-94d7-c13fcd68576d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc37d80-a035-4b86-8ff5-c44623a672b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:02 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Volume 87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68', 'volume_size': 1} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1823936715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ab034ba5314753a523ebbb57a48f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:03Z,use_quota=True,user_id='afc2b397555d49f5a39158aa73196039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Creating volume 87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:02 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:02 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68 1073741824 Apr 22 09:25:02 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:02 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.473s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:02 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f7bcce76-84f1-4417-a5fd-506201bc7ec5 tempest-GroupsTest-1117150674 None] Delete group completed successfully. Apr 22 09:25:02 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Flow 'volume_create_manager' (c81835cb-2766-40a6-9528-2ea89667797f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843b6211-ff77-4a19-814f-d9febf7d2d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (843b6211-ff77-4a19-814f-d9febf7d2d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-71620638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d962167b-f817-468c-87ae-ea4cf58c40f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d43dea979f400f987c4451da05170c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:03Z,use_quota=True,user_id='26c1758893934315b32528432a187805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e487435-1806-4454-b045-3403a6802476),volume_type_id=4e487435-1806-4454-b045-3403a6802476)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ade0f7-1acf-4f37-8da1-39eb786884e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7ade0f7-1acf-4f37-8da1-39eb786884e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e7a9ba-29cd-4ed3-811e-0eb6f2c7be79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69e7a9ba-29cd-4ed3-811e-0eb6f2c7be79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd962167b-f817-468c-87ae-ea4cf58c40f2', 'volume_name': 'volume-d962167b-f817-468c-87ae-ea4cf58c40f2', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb86b4b-c7df-4d0f-a628-26b55efeeced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eb86b4b-c7df-4d0f-a628-26b55efeeced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bfbb34-622b-406f-a5cd-0df2cde30594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:03 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Volume d962167b-f817-468c-87ae-ea4cf58c40f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d962167b-f817-468c-87ae-ea4cf58c40f2', 'volume_size': 1} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:03 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68 1073741824" returned: 0 in 0.629s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:03 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68 Apr 22 09:25:03 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:03 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68" returned: 0 in 0.559s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] <== create_volume: return (1217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.864s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-71620638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d962167b-f817-468c-87ae-ea4cf58c40f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d43dea979f400f987c4451da05170c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:03Z,use_quota=True,user_id='26c1758893934315b32528432a187805',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4e487435-1806-4454-b045-3403a6802476),volume_type_id=4e487435-1806-4454-b045-3403a6802476)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Creating volume d962167b-f817-468c-87ae-ea4cf58c40f2 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:03 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dc37d80-a035-4b86-8ff5-c44623a672b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7790be68-cb8d-403f-a664-57fb234ad9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:03 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Volume volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68 (87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68): created successfully Apr 22 09:25:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7790be68-cb8d-403f-a664-57fb234ad9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:04 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2 1073741824 Apr 22 09:25:04 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Flow 'volume_create_manager' (e5f28b02-7b26-4013-b533-c82021e98138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:04 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-27ffddf1-3bf2-4533-81c3-0b5970cb33d8 tempest-VolumesTransfersV357Test-1493774453 None] Created volume successfully. Apr 22 09:25:04 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2 1073741824" returned: 0 in 0.650s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:04 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2 Apr 22 09:25:04 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:05 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2" returned: 0 in 0.492s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bfbb34-622b-406f-a5cd-0df2cde30594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d962167b-f817-468c-87ae-ea4cf58c40f2', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b8f711-ad40-4271-906e-920e0f873e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:05 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Volume volume-d962167b-f817-468c-87ae-ea4cf58c40f2 (d962167b-f817-468c-87ae-ea4cf58c40f2): created successfully Apr 22 09:25:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7b8f711-ad40-4271-906e-920e0f873e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Flow 'volume_create_manager' (c81835cb-2766-40a6-9528-2ea89667797f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:05 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6747598b-4854-46bf-8897-2e6c4f9d3b46 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Created volume successfully. Apr 22 09:25:05 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b2cd1ae7-fcc1-4a4d-88d9-64391a9a670a tempest-VolumesTransfersV357Test-1007487058 None] Transfer volume completed successfully. Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e9935a67-c6da-4b7a-9fff-36f7cb0439c8 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e9935a67-c6da-4b7a-9fff-36f7cb0439c8 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e9935a67-c6da-4b7a-9fff-36f7cb0439c8 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e9935a67-c6da-4b7a-9fff-36f7cb0439c8 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e9935a67-c6da-4b7a-9fff-36f7cb0439c8 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e9935a67-c6da-4b7a-9fff-36f7cb0439c8 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:06 devstack sudo[87650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:06 devstack sudo[87650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Acquiring lock "cinder-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Lock "cinder-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Acquiring lock "cinder-quobyte-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Lock "cinder-quobyte-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[817f6127-29ff-4ea7-a567-66a07dd11254]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:06 devstack sudo[87652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68 Apr 22 09:25:06 devstack sudo[87652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:07 devstack sudo[87650]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e9935a67-c6da-4b7a-9fff-36f7cb0439c8 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.543s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-e9935a67-c6da-4b7a-9fff-36f7cb0439c8 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:07 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e9935a67-c6da-4b7a-9fff-36f7cb0439c8 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Retype volume completed successfully. Apr 22 09:25:07 devstack sudo[87652]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68" returned: 0 in 0.571s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:07 devstack sudo[87658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68 Apr 22 09:25:07 devstack sudo[87658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Flow 'volume_create_manager' (c2269849-e811-4e5f-851d-8310c75b0ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b33350-c3ec-45f3-9470-e2d215ceecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10b33350-c3ec-45f3-9470-e2d215ceecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-906137850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67a5725-1c7b-4616-a33a-f250abfe10cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf831e241e4ce68849df569803bf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:08Z,use_quota=True,user_id='4c2e9c14220148a5968910f28bfbcc7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efc2822-28c9-441e-bd38-a9f6a8214e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6efc2822-28c9-441e-bd38-a9f6a8214e11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62164c55-0466-4625-947d-eb0d679a0ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62164c55-0466-4625-947d-eb0d679a0ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f67a5725-1c7b-4616-a33a-f250abfe10cb', 'volume_name': 'volume-f67a5725-1c7b-4616-a33a-f250abfe10cb', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0836f36-fa85-415b-9033-1a9489ee9fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0836f36-fa85-415b-9033-1a9489ee9fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e081b5-b9c0-4243-9abb-799056d72b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:07 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Volume f67a5725-1c7b-4616-a33a-f250abfe10cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f67a5725-1c7b-4616-a33a-f250abfe10cb', 'volume_size': 1} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-906137850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f67a5725-1c7b-4616-a33a-f250abfe10cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf831e241e4ce68849df569803bf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:08Z,use_quota=True,user_id='4c2e9c14220148a5968910f28bfbcc7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Creating volume f67a5725-1c7b-4616-a33a-f250abfe10cb {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:07 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:07 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb 1073741824 Apr 22 09:25:07 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:07 devstack sudo[87658]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68" returned: 0 in 0.515s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Acquiring lock "cinder-d962167b-f817-468c-87ae-ea4cf58c40f2-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Lock "cinder-quobyte-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68" released by "delete_volume" :: held 1.120s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "cinder-d962167b-f817-468c-87ae-ea4cf58c40f2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Acquiring lock "cinder-quobyte-d962167b-f817-468c-87ae-ea4cf58c40f2" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "cinder-quobyte-d962167b-f817-468c-87ae-ea4cf58c40f2" acquired by "delete_volume" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[16164f61-c56c-4663-bb5c-8af9c9cbf650]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Created reservations ['8f8a21e4-41ed-485f-8492-7395f9cacef0', 'bd309c77-69d2-4976-b528-e35506d8e795', 'f8abf1e9-2292-4dd7-a11c-ec0dc7371105', 'fbbf9e64-f398-4cd8-885a-ba2ca1607908'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:07 devstack sudo[87663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2 Apr 22 09:25:07 devstack sudo[87663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:08 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:08 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:08 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb 1073741824" returned: 0 in 0.549s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:08 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb Apr 22 09:25:08 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:08 devstack sudo[87663]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2" returned: 0 in 0.533s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:08 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2 Apr 22 09:25:08 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:08 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.533s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:08 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Deleted volume successfully. Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31575d90-8397-47e5-987c-5238e2d7a4a3 tempest-VolumesTransfersV357Test-811596185 None] Lock "cinder-87bb8a2a-3c9f-4915-bdc5-eb1bc1a64d68-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:08 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb" returned: 0 in 0.539s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3e081b5-b9c0-4243-9abb-799056d72b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f67a5725-1c7b-4616-a33a-f250abfe10cb', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bcb880-f146-4f13-b01b-d0bf70f87dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:08 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Volume volume-f67a5725-1c7b-4616-a33a-f250abfe10cb (f67a5725-1c7b-4616-a33a-f250abfe10cb): created successfully Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19bcb880-f146-4f13-b01b-d0bf70f87dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Flow 'volume_create_manager' (c2269849-e811-4e5f-851d-8310c75b0ab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:08 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c736d003-083d-4654-84db-914ef902a7fd tempest-VolumesTransfersV355Test-1841656019 None] Created volume successfully. Apr 22 09:25:09 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d962167b-f817-468c-87ae-ea4cf58c40f2" returned: 0 in 0.553s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "cinder-quobyte-d962167b-f817-468c-87ae-ea4cf58c40f2" released by "delete_volume" :: held 1.108s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:09 devstack cinder-volume[82642]: WARNING cinder.quota [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:25:09 devstack cinder-volume[82642]: WARNING cinder.quota [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Created reservations ['61a3fd71-8da9-4f2a-810f-91d68e920715', 'fe1a9440-ff12-433e-b910-41cd20195496', 'e8e7e0de-3e76-4667-829e-b44fa3222089', '2fec76f3-fdb7-47a9-8457-dde1102f7dfa'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:09 devstack sudo[87680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:09 devstack sudo[87680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Flow 'volume_create_manager' (ec915ac6-a06f-4c8f-a76a-6fcbc9a8f805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d454742f-b11a-404b-a706-4ed870ec5cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d454742f-b11a-404b-a706-4ed870ec5cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1170385931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8b4962-dbb6-4cbb-a95a-00c65528ea7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ab034ba5314753a523ebbb57a48f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:09Z,use_quota=True,user_id='afc2b397555d49f5a39158aa73196039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215a1af8-10e7-4249-bf51-504d662adbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (215a1af8-10e7-4249-bf51-504d662adbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6316ebe-0a4c-4502-8826-a74d28a3a9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6316ebe-0a4c-4502-8826-a74d28a3a9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd8b4962-dbb6-4cbb-a95a-00c65528ea7d', 'volume_name': 'volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ffda38-d259-411a-86f9-24fc8b3a3592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ffda38-d259-411a-86f9-24fc8b3a3592) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6de184-f348-46fb-87de-f1058579db66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:09 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Volume bd8b4962-dbb6-4cbb-a95a-00c65528ea7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d', 'volume_size': 1} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1170385931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8b4962-dbb6-4cbb-a95a-00c65528ea7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96ab034ba5314753a523ebbb57a48f6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:09Z,use_quota=True,user_id='afc2b397555d49f5a39158aa73196039',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Creating volume bd8b4962-dbb6-4cbb-a95a-00c65528ea7d {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:09 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:09 devstack sudo[87682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d 1073741824 Apr 22 09:25:09 devstack sudo[87682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:09 devstack sudo[87680]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.445s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:09 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Deleted volume successfully. Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2cb03a7-a6fc-4009-a31d-ed185bdca562 tempest-VolumeRetypeWithoutMigrationTest-408892401 None] Lock "cinder-d962167b-f817-468c-87ae-ea4cf58c40f2-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:09 devstack sudo[87682]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d 1073741824" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:09 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d Apr 22 09:25:09 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:10 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d" returned: 0 in 0.467s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f6de184-f348-46fb-87de-f1058579db66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0b769f-c16d-4e25-87a7-f1a9702248d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:10 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Volume volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d (bd8b4962-dbb6-4cbb-a95a-00c65528ea7d): created successfully Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c0b769f-c16d-4e25-87a7-f1a9702248d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Flow 'volume_create_manager' (ec915ac6-a06f-4c8f-a76a-6fcbc9a8f805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:10 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-de0190c1-be68-4613-96d4-f75ec6c191ae tempest-VolumesTransfersV357Test-1493774453 None] Created volume successfully. Apr 22 09:25:10 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e3cc6e44-93bc-46bf-a56f-179488edd920 tempest-VolumesTransfersV355Test-1382281576 None] Transfer volume completed successfully. Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Flow 'volume_create_manager' (26dbfa68-0c19-4181-ab3f-571f7553f91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4681deba-a575-4f7f-a8e2-f549225982fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4681deba-a575-4f7f-a8e2-f549225982fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-197176823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa317547-d6b6-4786-a34c-f5eb212fbba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e636fcfae38549ffb2865e7a767bab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:11Z,use_quota=True,user_id='d072987d4f5b4707acf593b4e138eb98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846c070f-8247-481e-9235-260553f4a99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (846c070f-8247-481e-9235-260553f4a99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5ae870-6145-48ed-a817-a245c569ef43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba5ae870-6145-48ed-a817-a245c569ef43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa317547-d6b6-4786-a34c-f5eb212fbba4', 'volume_name': 'volume-aa317547-d6b6-4786-a34c-f5eb212fbba4', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f51f4c-b9ae-4a6a-b3db-eba7bc4f2b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f51f4c-b9ae-4a6a-b3db-eba7bc4f2b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd25019-0cc1-4d73-95c9-93c95b7c8464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:10 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Volume aa317547-d6b6-4786-a34c-f5eb212fbba4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa317547-d6b6-4786-a34c-f5eb212fbba4', 'volume_size': 1} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-197176823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa317547-d6b6-4786-a34c-f5eb212fbba4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e636fcfae38549ffb2865e7a767bab7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:11Z,use_quota=True,user_id='d072987d4f5b4707acf593b4e138eb98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Creating volume aa317547-d6b6-4786-a34c-f5eb212fbba4 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:10 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:10 devstack sudo[87691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4 1073741824 Apr 22 09:25:10 devstack sudo[87691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Acquiring lock "cinder-f67a5725-1c7b-4616-a33a-f250abfe10cb-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Lock "cinder-f67a5725-1c7b-4616-a33a-f250abfe10cb-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Acquiring lock "cinder-quobyte-f67a5725-1c7b-4616-a33a-f250abfe10cb" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Lock "cinder-quobyte-f67a5725-1c7b-4616-a33a-f250abfe10cb" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:11 devstack sudo[87691]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4 1073741824" returned: 0 in 0.664s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75149f6-4e2f-4819-b332-447f1cbe847e]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:11 devstack sudo[87791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4 Apr 22 09:25:11 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Acquiring lock "cinder-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Lock "cinder-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:11 devstack sudo[87768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb Apr 22 09:25:11 devstack sudo[87768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Acquiring lock "cinder-quobyte-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Lock "cinder-quobyte-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fd297f-86d9-4b13-bea1-d578c01bc710]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:11 devstack sudo[87932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d Apr 22 09:25:11 devstack sudo[87932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:12 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4" returned: 0 in 0.597s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] <== create_volume: return (1316ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd25019-0cc1-4d73-95c9-93c95b7c8464) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa317547-d6b6-4786-a34c-f5eb212fbba4', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddf678c-4307-4dd1-8cb3-46c21e7ab407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:12 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Volume volume-aa317547-d6b6-4786-a34c-f5eb212fbba4 (aa317547-d6b6-4786-a34c-f5eb212fbba4): created successfully Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bddf678c-4307-4dd1-8cb3-46c21e7ab407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Flow 'volume_create_manager' (26dbfa68-0c19-4181-ab3f-571f7553f91e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:12 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-558544d2-a2ae-48f2-b281-42064a2f3a65 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Created volume successfully. Apr 22 09:25:12 devstack sudo[87768]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb" returned: 0 in 0.706s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:12 devstack sudo[87932]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d" returned: 0 in 0.525s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:12 devstack sudo[87941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb Apr 22 09:25:12 devstack sudo[87941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:12 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d Apr 22 09:25:12 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:12 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d" returned: 0 in 0.405s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Lock "cinder-quobyte-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d" released by "delete_volume" :: held 0.964s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Created reservations ['75546a5d-467e-469a-b10d-0146abbda06f', 'c202cc90-b380-4a83-886b-af6c6ef2e996', '0df5fafd-7da2-4091-8eb3-2d84d472523c', 'ee6b8376-01fd-4802-83c2-7f307ce649ac'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:12 devstack sudo[87941]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-f67a5725-1c7b-4616-a33a-f250abfe10cb" returned: 0 in 0.486s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Lock "cinder-quobyte-f67a5725-1c7b-4616-a33a-f250abfe10cb" released by "delete_volume" :: held 1.268s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:12 devstack sudo[87947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:12 devstack sudo[87947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Created reservations ['b84c13d0-169d-4539-84c1-7a2e4ad06b6a', '6bc94a5f-dfa8-44a2-91d2-d3e692151b05', 'a4ba18dd-f7de-49ac-981a-1911dd819cc6', 'fb447b63-9a8a-4a1a-9b6c-1acc5b7544ee'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:12 devstack sudo[87949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:12 devstack sudo[87949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:13 devstack sudo[87949]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.449s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:13 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Deleted volume successfully. Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e69ee080-596c-4892-a84f-56cc67223586 tempest-VolumesTransfersV355Test-380931681 None] Lock "cinder-f67a5725-1c7b-4616-a33a-f250abfe10cb-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:13 devstack sudo[87947]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.576s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:13 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Deleted volume successfully. Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0da56e25-3806-410e-9406-5f53a455920b tempest-VolumesTransfersV357Test-811596185 None] Lock "cinder-bd8b4962-dbb6-4cbb-a95a-00c65528ea7d-delete_volume" released by "delete_volume" :: held 1.709s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Acquiring lock "cinder-aa317547-d6b6-4786-a34c-f5eb212fbba4-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Lock "cinder-aa317547-d6b6-4786-a34c-f5eb212fbba4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Acquiring lock "cinder-quobyte-aa317547-d6b6-4786-a34c-f5eb212fbba4" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Lock "cinder-quobyte-aa317547-d6b6-4786-a34c-f5eb212fbba4" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[527d9f90-264d-4d7e-8353-f9c7c553d077]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:13 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4 Apr 22 09:25:13 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Flow 'volume_create_manager' (f8e7bcee-551d-4b85-a452-9ebf9bb515fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61942e0e-e05d-4273-8e36-c78991f7213e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61942e0e-e05d-4273-8e36-c78991f7213e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-872595154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf831e241e4ce68849df569803bf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:14Z,use_quota=True,user_id='4c2e9c14220148a5968910f28bfbcc7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883285a7-dfc0-43d4-8d9a-ac5842ecc481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883285a7-dfc0-43d4-8d9a-ac5842ecc481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84f3ac2-fda8-4622-8bda-50c3e7337647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84f3ac2-fda8-4622-8bda-50c3e7337647) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c', 'volume_name': 'volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f6219d-ac55-4293-879b-82f641368771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f6219d-ac55-4293-879b-82f641368771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5daed5-310a-4933-aac5-6479e01b451e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:13 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Volume 8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c', 'volume_size': 1} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-872595154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1cf831e241e4ce68849df569803bf96',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:14Z,use_quota=True,user_id='4c2e9c14220148a5968910f28bfbcc7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Creating volume 8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:13 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:13 devstack sudo[87955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c 1073741824 Apr 22 09:25:13 devstack sudo[87955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:14 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4" returned: 0 in 0.621s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:14 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4 Apr 22 09:25:14 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:14 devstack sudo[87955]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c 1073741824" returned: 0 in 0.624s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:14 devstack sudo[87965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c Apr 22 09:25:14 devstack sudo[87965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:14 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aa317547-d6b6-4786-a34c-f5eb212fbba4" returned: 0 in 0.561s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Lock "cinder-quobyte-aa317547-d6b6-4786-a34c-f5eb212fbba4" released by "delete_volume" :: held 1.219s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Created reservations ['019dad92-8de2-47ab-bced-c644406f5f6c', '846eac7b-78b2-4830-b622-d67eba516960', '85057d98-e7a0-4feb-940a-be72f656a851', '23adc755-4d66-49b0-9e8f-a8f92be9df85'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:14 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:14 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:15 devstack sudo[87965]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c" returned: 0 in 0.615s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] <== create_volume: return (1278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.280s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c5daed5-310a-4933-aac5-6479e01b451e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a215e6-041a-451c-abe0-86c412c54c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:15 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Volume volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c (8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c): created successfully Apr 22 09:25:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54a215e6-041a-451c-abe0-86c412c54c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Flow 'volume_create_manager' (f8e7bcee-551d-4b85-a452-9ebf9bb515fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:15 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6704754e-c9c4-403e-822b-c78885741886 tempest-VolumesTransfersV355Test-1841656019 None] Created volume successfully. Apr 22 09:25:15 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.569s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:15 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:15 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Deleted volume successfully. Apr 22 09:25:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-971888be-fac3-4f14-b404-8f079e172174 tempest-VolumeQuotasNegativeTestJSON-847701446 None] Lock "cinder-aa317547-d6b6-4786-a34c-f5eb212fbba4-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Acquiring lock "cinder-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Lock "cinder-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Acquiring lock "cinder-quobyte-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Lock "cinder-quobyte-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c" acquired by "delete_volume" :: waited 0.019s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:16 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a21a5c34-08bd-4001-9c24-0b09660a02e6]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:16 devstack sudo[87972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c Apr 22 09:25:16 devstack sudo[87972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:16 devstack sudo[87972]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c" returned: 0 in 0.598s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:16 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c Apr 22 09:25:16 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:17 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c" returned: 0 in 0.574s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Lock "cinder-quobyte-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c" released by "delete_volume" :: held 1.210s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Flow 'volume_create_manager' (48746f99-585c-4609-9bfc-767ecf70af3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf149389-056d-4d59-8724-ba6ec6ad8583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf149389-056d-4d59-8724-ba6ec6ad8583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-936777504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409d50e0-0b75-4816-97df-5859cd6c1819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262f4208c2f84912970a5a6651c1ce72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:17Z,use_quota=True,user_id='b1b7189d54684f50930aa9afd063bece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(226a2a88-f3cc-49f5-a8dc-430f2e0d5d5d),volume_type_id=226a2a88-f3cc-49f5-a8dc-430f2e0d5d5d)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad76e001-14a5-4a7e-98ff-0f066bb319e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad76e001-14a5-4a7e-98ff-0f066bb319e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c371cae-f628-4bdb-b265-d4c1004f9eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c371cae-f628-4bdb-b265-d4c1004f9eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '409d50e0-0b75-4816-97df-5859cd6c1819', 'volume_name': 'volume-409d50e0-0b75-4816-97df-5859cd6c1819', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a8d20b-0435-4633-b359-f5053adc8f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a8d20b-0435-4633-b359-f5053adc8f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b21907-c49b-403e-ae8d-f5b639125a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:17 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Volume 409d50e0-0b75-4816-97df-5859cd6c1819: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-409d50e0-0b75-4816-97df-5859cd6c1819', 'volume_size': 1} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-936777504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=409d50e0-0b75-4816-97df-5859cd6c1819,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='262f4208c2f84912970a5a6651c1ce72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:17Z,use_quota=True,user_id='b1b7189d54684f50930aa9afd063bece',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(226a2a88-f3cc-49f5-a8dc-430f2e0d5d5d),volume_type_id=226a2a88-f3cc-49f5-a8dc-430f2e0d5d5d)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Creating volume 409d50e0-0b75-4816-97df-5859cd6c1819 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:17 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:17 devstack sudo[87980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819 1073741824 Apr 22 09:25:17 devstack sudo[87980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Created reservations ['9a1cb3db-b703-40fb-8483-d7bca3613483', '4603a0f8-1282-4c07-8728-71e0d066fa70', 'a376fc83-a302-43fc-9ec1-aaffa764dfcd', '9ea78d4c-2372-4982-9460-a2c41fc91e34'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:17 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:17 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Flow 'volume_create_manager' (550726b5-e0cf-4587-b88e-100d116f9b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8618f119-ada9-481f-a727-062275aa07cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8618f119-ada9-481f-a727-062275aa07cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-612404321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967f48222ad74ade81b7dd744b2c7f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:18Z,use_quota=True,user_id='6b313ae19a30405784efe14a4133f301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81988015-fbc8-4b25-9713-a860617406d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81988015-fbc8-4b25-9713-a860617406d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8908b6b-1275-4888-aa44-ac0032d6f4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8908b6b-1275-4888-aa44-ac0032d6f4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef', 'volume_name': 'volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef', 'volume_size': 2}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fce6917-3bf5-4340-9eb9-d212cbd48745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fce6917-3bf5-4340-9eb9-d212cbd48745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a957c13-9722-4e2b-a11f-ca01720f30d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:17 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Volume dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef', 'volume_size': 2} Apr 22 09:25:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:18 devstack sudo[87980]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819 1073741824" returned: 0 in 0.584s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:18 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.530s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:18 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Deleted volume successfully. Apr 22 09:25:18 devstack sudo[87988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819 Apr 22 09:25:18 devstack sudo[87988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bcab2d46-1451-42ca-b11f-ded37fed71a5 tempest-VolumesTransfersV355Test-380931681 None] Lock "cinder-8de6a7a6-2e6b-4120-be36-ebadbe2f7d9c-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:18 devstack sudo[87988]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819" returned: 0 in 0.454s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.727s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-612404321',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='967f48222ad74ade81b7dd744b2c7f45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:18Z,use_quota=True,user_id='6b313ae19a30405784efe14a4133f301',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Creating volume dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:18 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef 2147483648 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2b21907-c49b-403e-ae8d-f5b639125a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-409d50e0-0b75-4816-97df-5859cd6c1819', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240ad892-d5d2-4e92-8202-0273f60e3ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:18 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef 2147483648 Apr 22 09:25:18 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Volume volume-409d50e0-0b75-4816-97df-5859cd6c1819 (409d50e0-0b75-4816-97df-5859cd6c1819): created successfully Apr 22 09:25:18 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (240ad892-d5d2-4e92-8202-0273f60e3ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Flow 'volume_create_manager' (48746f99-585c-4609-9bfc-767ecf70af3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:18 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d066618d-6424-4eab-af36-4cfabc924feb tempest-VolumeTypesAccessTest-956812055 None] Created volume successfully. Apr 22 09:25:19 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef 2147483648" returned: 0 in 0.588s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:19 devstack sudo[87996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef Apr 22 09:25:19 devstack sudo[87996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Acquiring lock "cinder-409d50e0-0b75-4816-97df-5859cd6c1819-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Lock "cinder-409d50e0-0b75-4816-97df-5859cd6c1819-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Acquiring lock "cinder-quobyte-409d50e0-0b75-4816-97df-5859cd6c1819" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Lock "cinder-quobyte-409d50e0-0b75-4816-97df-5859cd6c1819" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Flow 'volume_create_manager' (cba797eb-d557-4e2d-a26f-548c925a1198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2151cbb-c599-4e6c-91f4-d01a804941d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d5cc80-e2dd-4137-a877-7948b7b53f06]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:19 devstack sudo[87996]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2151cbb-c599-4e6c-91f4-d01a804941d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1516395422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554fccf4-45d5-4e71-88ab-f9072bba3241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6248423f5f24783998f55aee134ebe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:20Z,use_quota=True,user_id='9680dbe0a14f4d1598df422f2f1f96cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67070371-29f3-4d21-8412-9f85f2005441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67070371-29f3-4d21-8412-9f85f2005441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107dafe5-88ab-4a0c-be4c-698f508f937d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (107dafe5-88ab-4a0c-be4c-698f508f937d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '554fccf4-45d5-4e71-88ab-f9072bba3241', 'volume_name': 'volume-554fccf4-45d5-4e71-88ab-f9072bba3241', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8aa6cd-a35c-469a-9a78-d594032217c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8aa6cd-a35c-469a-9a78-d594032217c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c38b878-d0db-4f50-8799-d1a9030aa27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:19 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Volume 554fccf4-45d5-4e71-88ab-f9072bba3241: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-554fccf4-45d5-4e71-88ab-f9072bba3241', 'volume_size': 1} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef" returned: 0 in 0.607s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1516395422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=554fccf4-45d5-4e71-88ab-f9072bba3241,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6248423f5f24783998f55aee134ebe1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:20Z,use_quota=True,user_id='9680dbe0a14f4d1598df422f2f1f96cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Creating volume 554fccf4-45d5-4e71-88ab-f9072bba3241 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:19 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a957c13-9722-4e2b-a11f-ca01720f30d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef', 'volume_size': 2}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b5c3ee-6676-41c8-9c2a-ebe9eea8b1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:19 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241 1073741824 Apr 22 09:25:19 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:19 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Volume volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef (dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef): created successfully Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b5c3ee-6676-41c8-9c2a-ebe9eea8b1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Flow 'volume_create_manager' (550726b5-e0cf-4587-b88e-100d116f9b89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:19 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819 Apr 22 09:25:19 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:19 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-8e0d4df4-f7c3-4cc6-9535-a7820130d345 tempest-VolumesCloneNegativeTest-2131032172 None] Created volume successfully. Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Acquiring lock "cinder-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Lock "cinder-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Acquiring lock "cinder-quobyte-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Lock "cinder-quobyte-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9522bdaf-2ef4-4ebf-b9b0-2d1280512660]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:20 devstack sudo[88003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef Apr 22 09:25:20 devstack sudo[88003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:20 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819" returned: 0 in 0.686s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:20 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241 1073741824" returned: 0 in 0.632s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:20 devstack sudo[88011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819 Apr 22 09:25:20 devstack sudo[88011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:20 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241 Apr 22 09:25:20 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:20 devstack sudo[88003]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef" returned: 0 in 0.598s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:20 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef Apr 22 09:25:20 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:21 devstack sudo[88011]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-409d50e0-0b75-4816-97df-5859cd6c1819" returned: 0 in 0.503s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Lock "cinder-quobyte-409d50e0-0b75-4816-97df-5859cd6c1819" released by "delete_volume" :: held 1.239s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:21 devstack cinder-volume[82642]: WARNING cinder.quota [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-865012192 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-865012192, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:25:21 devstack cinder-volume[82642]: WARNING cinder.quota [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-865012192 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-865012192, it is now deprecated. Please use the default quota class for default quota. Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Created reservations ['7570aaca-7b5c-4c33-ac14-cd25de4b4b60', '96bc1fa2-2b42-4d29-a996-aa606121b719', '9ac6c23b-f54b-45dd-a5d8-0619ed82c7c9', '57687be1-2958-48f3-a0e1-87076997da6c'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:21 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241" returned: 0 in 0.532s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] <== create_volume: return (1204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.207s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c38b878-d0db-4f50-8799-d1a9030aa27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-554fccf4-45d5-4e71-88ab-f9072bba3241', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42593aa-2453-4b03-bf32-7a98b123903e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:21 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Volume volume-554fccf4-45d5-4e71-88ab-f9072bba3241 (554fccf4-45d5-4e71-88ab-f9072bba3241): created successfully Apr 22 09:25:21 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:21 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42593aa-2453-4b03-bf32-7a98b123903e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Flow 'volume_create_manager' (cba797eb-d557-4e2d-a26f-548c925a1198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:21 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7bdb842b-cc58-467f-a889-53c17f2efb0a tempest-VolumesServicesTestJSON-219060572 None] Created volume successfully. Apr 22 09:25:21 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef" returned: 0 in 0.502s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Lock "cinder-quobyte-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef" released by "delete_volume" :: held 1.127s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Created reservations ['329baf46-438a-4547-9e38-5448904ca952', '45516cd2-27a7-4fa2-8ffd-37d6edc17e1b', '36caf526-f8a3-4893-ac4c-c586c922204b', 'c403a82f-d4d6-47b8-bb15-497957ce9f89'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:21 devstack sudo[88026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:21 devstack sudo[88026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:21 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.499s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:21 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Deleted volume successfully. Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2ddea4e9-ecd4-41e2-b2dc-1695fba07011 tempest-VolumeTypesAccessTest-956812055 None] Lock "cinder-409d50e0-0b75-4816-97df-5859cd6c1819-delete_volume" released by "delete_volume" :: held 1.965s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:21 devstack sudo[88026]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.497s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:21 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Deleted volume successfully. Apr 22 09:25:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9afb2793-5233-4522-82e5-fe5568481c6f tempest-VolumesCloneNegativeTest-2131032172 None] Lock "cinder-dfb4f36f-6b4e-4a7a-8ed7-a357cc192bef-delete_volume" released by "delete_volume" :: held 1.774s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Acquiring lock "cinder-554fccf4-45d5-4e71-88ab-f9072bba3241-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Lock "cinder-554fccf4-45d5-4e71-88ab-f9072bba3241-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Acquiring lock "cinder-quobyte-554fccf4-45d5-4e71-88ab-f9072bba3241" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Lock "cinder-quobyte-554fccf4-45d5-4e71-88ab-f9072bba3241" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:22 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2155859-6312-443a-b496-a60df56863a1]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:22 devstack sudo[88030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241 Apr 22 09:25:22 devstack sudo[88030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:22 devstack sudo[88030]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241" returned: 0 in 0.615s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:22 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241 Apr 22 09:25:22 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:23 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-554fccf4-45d5-4e71-88ab-f9072bba3241" returned: 0 in 0.597s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Lock "cinder-quobyte-554fccf4-45d5-4e71-88ab-f9072bba3241" released by "delete_volume" :: held 1.240s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Created reservations ['b34c1bdf-7410-4b02-b5f5-264bdb49da8e', 'da97a759-9a10-4e02-ae27-9287bd6993c4', '3e9ade4f-e8a1-445d-8434-4ac40a0e36fe', '516ee399-7a50-47fd-a5bc-f77a00584ce0'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:23 devstack sudo[88038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:23 devstack sudo[88038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:23 devstack sudo[88038]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.563s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:23 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Deleted volume successfully. Apr 22 09:25:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b672ed0-52aa-4e6f-9d9d-9a49be631a0a tempest-VolumesServicesTestJSON-219060572 None] Lock "cinder-554fccf4-45d5-4e71-88ab-f9072bba3241-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (04cd8758-7f5d-46ed-86c8-5fa7c0406d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f968b97-84a7-4ba4-bdf1-23895387e739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f968b97-84a7-4ba4-bdf1-23895387e739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-245000860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94c7655-3213-47bd-bcd7-39f1d5fcd6c8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:25Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6248e6ea-ac45-4aaa-8334-097774845f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6248e6ea-ac45-4aaa-8334-097774845f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9785d51-ac76-4c6d-8a06-29289da85fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9785d51-ac76-4c6d-8a06-29289da85fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b94c7655-3213-47bd-bcd7-39f1d5fcd6c8', 'volume_name': 'volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef009d22-fb0d-4abf-9e09-942db81671c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef009d22-fb0d-4abf-9e09-942db81671c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f299b52-fa5f-4c5a-b93c-84750483c0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:25 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Volume b94c7655-3213-47bd-bcd7-39f1d5fcd6c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8', 'volume_size': 1} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-245000860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b94c7655-3213-47bd-bcd7-39f1d5fcd6c8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:25Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Creating volume b94c7655-3213-47bd-bcd7-39f1d5fcd6c8 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:25 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:25 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8 1073741824 Apr 22 09:25:25 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:25 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8 1073741824" returned: 0 in 0.617s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:25 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8 Apr 22 09:25:25 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:26 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8" returned: 0 in 0.555s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:26 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f299b52-fa5f-4c5a-b93c-84750483c0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26aff460-49e6-4e80-bd68-f130e615add8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:26 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Volume volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8 (b94c7655-3213-47bd-bcd7-39f1d5fcd6c8): created successfully Apr 22 09:25:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26aff460-49e6-4e80-bd68-f130e615add8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:26 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (04cd8758-7f5d-46ed-86c8-5fa7c0406d6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:26 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-a356c3eb-1555-4dee-822e-24396aa250ae tempest-VolumesGetTest-874813522 None] Created volume successfully. Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (331f3fa3-07b4-498b-9087-fd373a2d0d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d5d357-f240-48f4-aaa0-21ecae1c561d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2d5d357-f240-48f4-aaa0-21ecae1c561d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-195100271',display_name='tempest-VolumesGetTest-Volume-1667414943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:28Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a95447-c507-4903-88f7-92401c0ff8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4a95447-c507-4903-88f7-92401c0ff8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cfc5f5-8d30-4e03-bae2-37ebfbce8e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cfc5f5-8d30-4e03-bae2-37ebfbce8e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce', 'volume_name': 'volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3295a95-5e75-43d8-90d1-a4be9ea2197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3295a95-5e75-43d8-90d1-a4be9ea2197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671baa7a-7be5-48fb-a8a1-cf2a08afe5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:28 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Volume 0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce', 'volume_size': 1} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-195100271',display_name='tempest-VolumesGetTest-Volume-1667414943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:28Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Creating volume 0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:28 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:28 devstack sudo[88050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce 1073741824 Apr 22 09:25:28 devstack sudo[88050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:28 devstack sudo[88050]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce 1073741824" returned: 0 in 0.719s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:29 devstack sudo[88055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce Apr 22 09:25:29 devstack sudo[88055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:29 devstack sudo[88055]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce" returned: 0 in 0.593s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:29 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] <== create_volume: return (1347ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.350s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (671baa7a-7be5-48fb-a8a1-cf2a08afe5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bfed57-b381-4c39-a554-c77973dc0f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:29 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Volume volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce (0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce): created successfully Apr 22 09:25:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99bfed57-b381-4c39-a554-c77973dc0f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (331f3fa3-07b4-498b-9087-fd373a2d0d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:29 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-3ca74312-9f56-4d76-a318-ef5cc60baf35 tempest-VolumesGetTest-874813522 None] Created volume successfully. Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=209,cinder:INSERT=58,cinder:UPDATE=284,cinder:DELETE=26 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Flow 'volume_create_manager' (85fbb957-a40b-4770-b670-b38a06a7a4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0e026e-b037-4744-865a-56c8e41ae0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc0e026e-b037-4744-865a-56c8e41ae0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-935096517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb546f0-ed2a-4c36-bf14-cccaaff979d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19100d769aeb4a6a884e34f63cbeba34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:30Z,use_quota=True,user_id='9585c35714aa4e79b9ce976981142850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da210f4c-55fd-4b42-84ce-342be6cd411a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da210f4c-55fd-4b42-84ce-342be6cd411a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704f0491-1cb9-4ab4-85b3-3b5ae3acda43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (704f0491-1cb9-4ab4-85b3-3b5ae3acda43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb546f0-ed2a-4c36-bf14-cccaaff979d3', 'volume_name': 'volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ce4a77-d136-4bbf-8c5d-4017fecb77a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4ce4a77-d136-4bbf-8c5d-4017fecb77a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc259d4b-9ade-4d27-89b3-30d327f7ea9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:30 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Volume 9cb546f0-ed2a-4c36-bf14-cccaaff979d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3', 'volume_size': 1} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-935096517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb546f0-ed2a-4c36-bf14-cccaaff979d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19100d769aeb4a6a884e34f63cbeba34',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:30Z,use_quota=True,user_id='9585c35714aa4e79b9ce976981142850',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Creating volume 9cb546f0-ed2a-4c36-bf14-cccaaff979d3 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:30 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:30 devstack sudo[88058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 1073741824 Apr 22 09:25:30 devstack sudo[88058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Lock "cinder-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-quobyte-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[530753a9-69ef-4d57-86d1-7297b52f5a69]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:30 devstack sudo[88060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce Apr 22 09:25:30 devstack sudo[88060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_service.periodic_task [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:30 devstack sudo[88062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:30 devstack sudo[88062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:31 devstack sudo[88058]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 1073741824" returned: 0 in 0.875s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=198,cinder:UPDATE=262,cinder:INSERT=65,cinder:DELETE=17 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:25:31 devstack sudo[88060]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce" returned: 0 in 0.576s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:31 devstack sudo[88070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce Apr 22 09:25:31 devstack sudo[88070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:31 devstack sudo[88073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 Apr 22 09:25:31 devstack sudo[88073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:31 devstack sudo[88062]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.789s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:31 devstack sudo[88070]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce" returned: 0 in 0.530s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce" released by "delete_volume" :: held 1.153s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Created reservations ['23b7cad3-c05c-48e0-bb86-e0a7b382a729', 'aa21d96a-0ae9-40a2-95a1-81a9f86380f9', '15029496-910b-463d-a82a-e5169e9a9b62', '86c99c1d-bc26-48d0-8b67-9c6c8ccbc5f6'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:31 devstack sudo[88073]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" returned: 0 in 0.630s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:31 devstack sudo[88078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:31 devstack sudo[88078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc259d4b-9ade-4d27-89b3-30d327f7ea9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0d5ca0-22b7-4cbf-876a-ce2a40cfe521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:31 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Volume volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 (9cb546f0-ed2a-4c36-bf14-cccaaff979d3): created successfully Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0d5ca0-22b7-4cbf-876a-ce2a40cfe521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Flow 'volume_create_manager' (85fbb957-a40b-4770-b670-b38a06a7a4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:31 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-9b1a60ab-55cc-45cd-8c4f-516e2d130e02 tempest-VolumesActionsTest-1597940252 None] Created volume successfully. Apr 22 09:25:32 devstack sudo[88078]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:32 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:32 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Deleted volume successfully. Apr 22 09:25:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-94705933-256a-4f99-8138-18177ad17df9 tempest-VolumesGetTest-874813522 None] Lock "cinder-0cc9cda8-ca6e-4aaf-85af-2e42f9dbdbce-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Lock "cinder-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-quobyte-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8" acquired by "delete_volume" :: waited 0.019s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:32 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bec4d9-7bf0-48ce-be86-d5b08124f502]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:32 devstack sudo[88087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8 Apr 22 09:25:32 devstack sudo[88087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Flow 'volume_create_manager' (bb403d37-7a5c-4835-afbb-d2603d874e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969f7060-a796-4658-849d-bc79a5bdc3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (969f7060-a796-4658-849d-bc79a5bdc3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1653010256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a583620a-427d-49f4-a941-0f7201c72ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad190515f2d7489cb43d4c5ab8baa60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:33Z,use_quota=True,user_id='aad3a1b7ffd84af0909b42559069e136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f112da1-0055-4723-9a1c-798fb24e54d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f112da1-0055-4723-9a1c-798fb24e54d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e300e77-0058-4510-bc0a-dc3d47c5d69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e300e77-0058-4510-bc0a-dc3d47c5d69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a583620a-427d-49f4-a941-0f7201c72ec4', 'volume_name': 'volume-a583620a-427d-49f4-a941-0f7201c72ec4', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b442f3b-edea-4488-bf59-44192060f478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b442f3b-edea-4488-bf59-44192060f478) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d3dddb-548a-40d8-837c-e3af8ed52474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:33 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Volume a583620a-427d-49f4-a941-0f7201c72ec4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a583620a-427d-49f4-a941-0f7201c72ec4', 'volume_size': 1} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1653010256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a583620a-427d-49f4-a941-0f7201c72ec4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad190515f2d7489cb43d4c5ab8baa60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:33Z,use_quota=True,user_id='aad3a1b7ffd84af0909b42559069e136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Creating volume a583620a-427d-49f4-a941-0f7201c72ec4 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:33 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:33 devstack sudo[88089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4 1073741824 Apr 22 09:25:33 devstack sudo[88089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:33 devstack sudo[88087]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8" returned: 0 in 0.692s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:33 devstack sudo[88097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8 Apr 22 09:25:33 devstack sudo[88097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:33 devstack sudo[88089]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4 1073741824" returned: 0 in 0.613s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:33 devstack sudo[88102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4 Apr 22 09:25:33 devstack sudo[88102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:33 devstack sudo[88097]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8" returned: 0 in 0.485s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8" released by "delete_volume" :: held 1.209s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:33 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Created reservations ['1fb57510-9b3d-49e4-a7a5-58c3a9b325b1', 'c2485c17-eeb6-493b-b4ef-061fd2bff113', 'f4f8743b-17c6-4b62-90b1-70c91eb5b883', 'e44c1a97-40ed-414f-8b02-0274bbc454ae'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:34 devstack sudo[88106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:34 devstack sudo[88106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:34 devstack sudo[88102]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4" returned: 0 in 0.505s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d3dddb-548a-40d8-837c-e3af8ed52474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a583620a-427d-49f4-a941-0f7201c72ec4', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19046a4d-8844-458f-a47f-a04b4b05c574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:34 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Volume volume-a583620a-427d-49f4-a941-0f7201c72ec4 (a583620a-427d-49f4-a941-0f7201c72ec4): created successfully Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19046a4d-8844-458f-a47f-a04b4b05c574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Flow 'volume_create_manager' (bb403d37-7a5c-4835-afbb-d2603d874e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:34 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b250a704-99ba-4b7f-8768-dad6f48844f3 tempest-VolumesListAdminTestJSON-1214508794 None] Created volume successfully. Apr 22 09:25:34 devstack sudo[88106]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.491s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:34 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Deleted volume successfully. Apr 22 09:25:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2574af8-d64b-45f0-9e67-9d13affd221a tempest-VolumesGetTest-874813522 None] Lock "cinder-b94c7655-3213-47bd-bcd7-39f1d5fcd6c8-delete_volume" released by "delete_volume" :: held 1.915s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (bdc92114-2422-4e7f-9bb7-5cfe92dff6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe19544-ce2a-4504-add6-7c04cd1332d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe19544-ce2a-4504-add6-7c04cd1332d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-61141783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd073d4a-f405-42a0-884b-70f6303daf07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:35Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3803bcc-966e-4c8c-af0e-59de108cdc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3803bcc-966e-4c8c-af0e-59de108cdc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b81c6ef-c74f-417a-8acb-a1e237a1d48d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b81c6ef-c74f-417a-8acb-a1e237a1d48d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd073d4a-f405-42a0-884b-70f6303daf07', 'volume_name': 'volume-dd073d4a-f405-42a0-884b-70f6303daf07', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8cb614-f8f0-449c-b589-88734910ee47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e8cb614-f8f0-449c-b589-88734910ee47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a223f5-461d-4efa-a9f1-702c29c51b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:35 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Volume dd073d4a-f405-42a0-884b-70f6303daf07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd073d4a-f405-42a0-884b-70f6303daf07', 'volume_size': 1} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-61141783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd073d4a-f405-42a0-884b-70f6303daf07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:35Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Creating volume dd073d4a-f405-42a0-884b-70f6303daf07 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:35 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:35 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 1073741824 Apr 22 09:25:35 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Flow 'volume_create_manager' (3d24fcdb-7570-4e88-bcf1-dddf4d805869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d68bc1-1890-45ac-bc87-c60a009fdaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50d68bc1-1890-45ac-bc87-c60a009fdaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-38483684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd019be7-4c44-489e-b165-7731efb0d7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad190515f2d7489cb43d4c5ab8baa60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:35Z,use_quota=True,user_id='aad3a1b7ffd84af0909b42559069e136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2491efc-ca07-43fa-ad1c-2daadcd57042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2491efc-ca07-43fa-ad1c-2daadcd57042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4314189-0353-4f95-802e-ad3d86bfb8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4314189-0353-4f95-802e-ad3d86bfb8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd019be7-4c44-489e-b165-7731efb0d7f8', 'volume_name': 'volume-cd019be7-4c44-489e-b165-7731efb0d7f8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cce58ee-dcc2-48ba-85b9-7d2851ba5d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cce58ee-dcc2-48ba-85b9-7d2851ba5d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f8d710-237f-41ed-95d1-d8faeaf04bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:35 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Volume cd019be7-4c44-489e-b165-7731efb0d7f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd019be7-4c44-489e-b165-7731efb0d7f8', 'volume_size': 1} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:35 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 1073741824" returned: 0 in 0.604s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:35 devstack sudo[88115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 Apr 22 09:25:35 devstack sudo[88115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:36 devstack sudo[88115]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07" returned: 0 in 0.537s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] <== create_volume: return (1172ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.002s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-38483684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd019be7-4c44-489e-b165-7731efb0d7f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad190515f2d7489cb43d4c5ab8baa60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:35Z,use_quota=True,user_id='aad3a1b7ffd84af0909b42559069e136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Creating volume cd019be7-4c44-489e-b165-7731efb0d7f8 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:36 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85a223f5-461d-4efa-a9f1-702c29c51b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd073d4a-f405-42a0-884b-70f6303daf07', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7568a21-a2cd-4657-b9a9-147df500c3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:36 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Volume volume-dd073d4a-f405-42a0-884b-70f6303daf07 (dd073d4a-f405-42a0-884b-70f6303daf07): created successfully Apr 22 09:25:36 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8 1073741824 Apr 22 09:25:36 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7568a21-a2cd-4657-b9a9-147df500c3d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (bdc92114-2422-4e7f-9bb7-5cfe92dff6c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:36 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4885dfc2-4af4-421e-bf98-e706f96982d5 tempest-VolumesGetTest-874813522 None] Created volume successfully. Apr 22 09:25:37 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8 1073741824" returned: 0 in 0.664s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:37 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8 Apr 22 09:25:37 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (fc1a7927-3c62-4cae-9803-16245bd1d7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9bbe22-7b6c-4a26-90c5-1998268d1e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c9bbe22-7b6c-4a26-90c5-1998268d1e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-172585951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77b8497d-9abd-4271-bbad-3534fe5ca44d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=dd073d4a-f405-42a0-884b-70f6303daf07,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:38Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36be174-6707-4cd1-9f11-8eb4a52fc963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36be174-6707-4cd1-9f11-8eb4a52fc963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28eac698-43c2-4828-af75-d2e31b312fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:37 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8" returned: 0 in 0.639s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28eac698-43c2-4828-af75-d2e31b312fa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '77b8497d-9abd-4271-bbad-3534fe5ca44d', 'volume_name': 'volume-77b8497d-9abd-4271-bbad-3534fe5ca44d', 'volume_size': 1, 'source_volid': 'dd073d4a-f405-42a0-884b-70f6303daf07', 'source_volstatus': 'available'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66025d81-2779-48ef-9f47-41d476917ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66025d81-2779-48ef-9f47-41d476917ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec6f456-2dd6-4581-b48f-f66813638a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:37 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Volume 77b8497d-9abd-4271-bbad-3534fe5ca44d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-77b8497d-9abd-4271-bbad-3534fe5ca44d', 'volume_size': 1, 'source_volid': 'dd073d4a-f405-42a0-884b-70f6303daf07', 'source_volstatus': 'available'} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1f8d710-237f-41ed-95d1-d8faeaf04bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd019be7-4c44-489e-b165-7731efb0d7f8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0000c8c6-ec80-4bdc-a85a-ac2e7d0cee97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:37 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Cloning volume dd073d4a-f405-42a0-884b-70f6303daf07 to volume 77b8497d-9abd-4271-bbad-3534fe5ca44d Apr 22 09:25:37 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Volume volume-cd019be7-4c44-489e-b165-7731efb0d7f8 (cd019be7-4c44-489e-b165-7731efb0d7f8): created successfully Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0000c8c6-ec80-4bdc-a85a-ac2e7d0cee97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Flow 'volume_create_manager' (3d24fcdb-7570-4e88-bcf1-dddf4d805869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:37 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ead6a13a-c144-4d00-ac33-46009f30390d tempest-VolumesListAdminTestJSON-1214508794 None] Created volume successfully. Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Creating offline snapshot 31669896-ca92-474a-a019-c6f98ad868b9 of volume dd073d4a-f405-42a0-884b-70f6303daf07 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd04ffe-86e5-4306-b641-2d462347ad3f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:38 devstack sudo[88160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 Apr 22 09:25:38 devstack sudo[88160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:38 devstack sudo[88160]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07" returned: 0 in 0.723s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:38 devstack sudo[88165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 1G Apr 22 09:25:38 devstack sudo[88165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Flow 'volume_create_manager' (1e845fcb-fe42-4a98-92ee-40858fec5640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e85707-5f23-4344-84c8-e9d464cf55a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49e85707-5f23-4344-84c8-e9d464cf55a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-656927228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75649fab-8e0a-4c97-9ac5-2b28ebb6edd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad190515f2d7489cb43d4c5ab8baa60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:39Z,use_quota=True,user_id='aad3a1b7ffd84af0909b42559069e136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55bd7fc7-d1b0-48eb-af57-76df326825ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55bd7fc7-d1b0-48eb-af57-76df326825ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5eaac0-7b83-4d42-81eb-16ac831e0f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c5eaac0-7b83-4d42-81eb-16ac831e0f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75649fab-8e0a-4c97-9ac5-2b28ebb6edd9', 'volume_name': 'volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3a06da-96d3-499d-abbe-f47cb9ee0adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db3a06da-96d3-499d-abbe-f47cb9ee0adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d553e6f6-5bd8-4b5a-b294-0f191598dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:39 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Volume 75649fab-8e0a-4c97-9ac5-2b28ebb6edd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9', 'volume_size': 1} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:39 devstack sudo[88165]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 1G" returned: 0 in 0.716s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd073d4a-f405-42a0-884b-70f6303daf07 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:39 devstack sudo[88170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd073d4a-f405-42a0-884b-70f6303daf07 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 Apr 22 09:25:39 devstack sudo[88170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:39 devstack sudo[88170]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd073d4a-f405-42a0-884b-70f6303daf07 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9" returned: 0 in 0.555s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:39 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 is being set with open permissions: ugo+rw Apr 22 09:25:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:39 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 Apr 22 09:25:39 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:40 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9" returned: 0 in 0.487s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:40 devstack sudo[88194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.info Apr 22 09:25:40 devstack sudo[88194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:40 devstack sudo[88194]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.info" returned: 0 in 0.476s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:40 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.info is being set with open permissions: ugo+rw Apr 22 09:25:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:40 devstack sudo[88197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.info Apr 22 09:25:40 devstack sudo[88197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:41 devstack sudo[88197]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.info" returned: 0 in 0.467s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-quobyte-77b8497d-9abd-4271-bbad-3534fe5ca44d" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-77b8497d-9abd-4271-bbad-3534fe5ca44d" acquired by "_copy_volume_from_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] snapshot: 31669896-ca92-474a-a019-c6f98ad868b9, volume: 77b8497d-9abd-4271-bbad-3534fe5ca44d, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:25:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:41 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[579ac2f7-940d-485b-b877-a411898ff6c3]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:41 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 Apr 22 09:25:41 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:42 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9" returned: 0 in 0.625s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:42 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd073d4a-f405-42a0-884b-70f6303daf07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:25:42 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:25:42 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:25:42 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0343d9-0761-42b9-a1f7-facd056e8b66]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:42 devstack sudo[88206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 Apr 22 09:25:42 devstack sudo[88206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:42 devstack sudo[88206]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07" returned: 0 in 0.573s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:42 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:25:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:42 devstack sudo[88211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d Apr 22 09:25:42 devstack sudo[88211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:45 devstack sudo[88211]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d" returned: 0 in 2.736s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:45 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5ce2e7f-c054-470b-bcc1-721442d3fd27]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:45 devstack sudo[88240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 Apr 22 09:25:45 devstack sudo[88240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:46 devstack sudo[88240]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07" returned: 0 in 0.998s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:46 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07, size 1024.00 MB, duration 2.74 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:25:46 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Converted 1024.00 MB image at 374.05 MB/s Apr 22 09:25:46 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d is being set with open permissions: ugo+rw Apr 22 09:25:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:46 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d Apr 22 09:25:46 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:47 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d" returned: 0 in 0.663s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-77b8497d-9abd-4271-bbad-3534fe5ca44d" released by "_copy_volume_from_snapshot" :: held 5.645s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-quobyte-31669896-ca92-474a-a019-c6f98ad868b9" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-31669896-ca92-474a-a019-c6f98ad868b9" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Deleting offline snapshot 31669896-ca92-474a-a019-c6f98ad868b9 of volume dd073d4a-f405-42a0-884b-70f6303daf07 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] snapshot_file for this snap is: volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b90d2b7-3962-4fc9-a3f5-0cac3cf1ee82]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:47 devstack sudo[88279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 Apr 22 09:25:47 devstack sudo[88279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:47 devstack sudo[88279]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9" returned: 0 in 0.653s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd073d4a-f405-42a0-884b-70f6303daf07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4f49d0-2f5c-43c6-a5bf-fdb2fe6a2c38]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:47 devstack sudo[88284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 Apr 22 09:25:47 devstack sudo[88284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:48 devstack sudo[88284]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07" returned: 0 in 0.521s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:48 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 Apr 22 09:25:48 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d044a69f-ab3a-4672-a8cc-6c15fb1fd1dc tempest-VolumesActionsTest-1597940252 None] Acquiring lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" by "attach_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d044a69f-ab3a-4672-a8cc-6c15fb1fd1dc tempest-VolumesActionsTest-1597940252 None] Lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" acquired by "attach_volume" :: waited 0.016s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:48 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d044a69f-ab3a-4672-a8cc-6c15fb1fd1dc tempest-VolumesActionsTest-1597940252 None] Attaching volume 9cb546f0-ed2a-4c36-bf14-cccaaff979d3 to instance a3062dcf-e992-4fac-8654-6504251448dd at mountpoint /dev/vdb on host None. Apr 22 09:25:48 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d044a69f-ab3a-4672-a8cc-6c15fb1fd1dc tempest-VolumesActionsTest-1597940252 None] Attach volume completed successfully. Apr 22 09:25:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d044a69f-ab3a-4672-a8cc-6c15fb1fd1dc tempest-VolumesActionsTest-1597940252 None] Lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" released by "attach_volume" :: held 0.106s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:48 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9" returned: 0 in 0.710s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:49 devstack sudo[88294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9 Apr 22 09:25:49 devstack sudo[88294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c73cab66-0e97-4502-946e-6240f15baf15 tempest-VolumesActionsTest-1597940252 None] Acquiring lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3-detach_volume" by "detach_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c73cab66-0e97-4502-946e-6240f15baf15 tempest-VolumesActionsTest-1597940252 None] Lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:49 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c73cab66-0e97-4502-946e-6240f15baf15 tempest-VolumesActionsTest-1597940252 None] Detaching volume 9cb546f0-ed2a-4c36-bf14-cccaaff979d3 from instance a3062dcf-e992-4fac-8654-6504251448dd. Apr 22 09:25:49 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c73cab66-0e97-4502-946e-6240f15baf15 tempest-VolumesActionsTest-1597940252 None] Detach volume completed successfully. Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c73cab66-0e97-4502-946e-6240f15baf15 tempest-VolumesActionsTest-1597940252 None] Lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:49 devstack sudo[88294]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07.31669896-ca92-474a-a019-c6f98ad868b9" returned: 0 in 0.497s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-31669896-ca92-474a-a019-c6f98ad868b9" released by "_delete_snapshot" :: held 2.439s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.654s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.442s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-656927228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75649fab-8e0a-4c97-9ac5-2b28ebb6edd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad190515f2d7489cb43d4c5ab8baa60a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:39Z,use_quota=True,user_id='aad3a1b7ffd84af0909b42559069e136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Creating volume 75649fab-8e0a-4c97-9ac5-2b28ebb6edd9 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:49 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bec6f456-2dd6-4581-b48f-f66813638a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77b8497d-9abd-4271-bbad-3534fe5ca44d', 'volume_size': 1, 'source_volid': 'dd073d4a-f405-42a0-884b-70f6303daf07', 'source_volstatus': 'available'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:49 devstack sudo[88297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9 1073741824 Apr 22 09:25:49 devstack sudo[88297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035e4206-e29c-40bb-b30b-7dfb90ee4417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:49 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Volume volume-77b8497d-9abd-4271-bbad-3534fe5ca44d (77b8497d-9abd-4271-bbad-3534fe5ca44d): created successfully Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (035e4206-e29c-40bb-b30b-7dfb90ee4417) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (fc1a7927-3c62-4cae-9803-16245bd1d7fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:49 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b5ff56e9-71d1-4824-8e84-7da262a8af5f tempest-VolumesGetTest-874813522 None] Created volume successfully. Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (2a3da707-fac8-45bd-87ce-ccce663de424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c28a30e-4f3a-4209-924a-ac0f99667cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c28a30e-4f3a-4209-924a-ac0f99667cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-291923794',display_name='tempest-VolumesGetTest-Volume-1586060198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee3541a-a1b1-4ff1-bf93-7c925577fded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:50Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab470aa7-1671-4adc-90e2-ffa62bb2e765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab470aa7-1671-4adc-90e2-ffa62bb2e765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:50 devstack sudo[88297]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60e9aa5-ff78-4b44-a397-fb67921e48a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a60e9aa5-ff78-4b44-a397-fb67921e48a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dee3541a-a1b1-4ff1-bf93-7c925577fded', 'volume_name': 'volume-dee3541a-a1b1-4ff1-bf93-7c925577fded', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d08512b-808a-4034-a699-e54cbcd7857a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d08512b-808a-4034-a699-e54cbcd7857a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93e816a-8f15-4dc4-9019-2a0da6aa3940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:50 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Volume dee3541a-a1b1-4ff1-bf93-7c925577fded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dee3541a-a1b1-4ff1-bf93-7c925577fded', 'volume_size': 1} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9 1073741824" returned: 0 in 1.046s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:50 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9 Apr 22 09:25:50 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:51 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9" returned: 0 in 0.536s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] <== create_volume: return (1623ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-291923794',display_name='tempest-VolumesGetTest-Volume-1586060198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dee3541a-a1b1-4ff1-bf93-7c925577fded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:50Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Creating volume dee3541a-a1b1-4ff1-bf93-7c925577fded {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:51 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d553e6f6-5bd8-4b5a-b294-0f191598dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c182ea-1313-4dac-a3f5-38ff45dd9880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:51 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded 1073741824 Apr 22 09:25:51 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:51 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Volume volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9 (75649fab-8e0a-4c97-9ac5-2b28ebb6edd9): created successfully Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c182ea-1313-4dac-a3f5-38ff45dd9880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Flow 'volume_create_manager' (1e845fcb-fe42-4a98-92ee-40858fec5640) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:51 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-3999759f-2f03-4227-abc3-5cb5ee2e073b tempest-VolumesListAdminTestJSON-1214508794 None] Created volume successfully. Apr 22 09:25:51 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded 1073741824" returned: 0 in 0.579s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:51 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded Apr 22 09:25:51 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:52 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded" returned: 0 in 0.453s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d93e816a-8f15-4dc4-9019-2a0da6aa3940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dee3541a-a1b1-4ff1-bf93-7c925577fded', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7675e79-0531-4960-bc04-f09d4a8c0d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:52 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Volume volume-dee3541a-a1b1-4ff1-bf93-7c925577fded (dee3541a-a1b1-4ff1-bf93-7c925577fded): created successfully Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7675e79-0531-4960-bc04-f09d4a8c0d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (2a3da707-fac8-45bd-87ce-ccce663de424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:52 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ebeea60b-1e86-47b9-ba79-e0e0c726e928 tempest-VolumesGetTest-874813522 None] Created volume successfully. Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-dee3541a-a1b1-4ff1-bf93-7c925577fded-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Lock "cinder-dee3541a-a1b1-4ff1-bf93-7c925577fded-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Flow 'volume_create_manager' (ff0e8812-f4e6-4e80-9698-fe16f192bf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b58cf0a-4d38-4694-9bae-63853ffe9c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-quobyte-dee3541a-a1b1-4ff1-bf93-7c925577fded" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b58cf0a-4d38-4694-9bae-63853ffe9c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c506772-7779-46aa-be3c-43d51fa1760b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ebb39a0c90248a68b4231cb700874ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:53Z,use_quota=True,user_id='397ed31e1e68480d82d868555b22beab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003cef51-4d5b-47ed-9c9b-df59cef1065f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (003cef51-4d5b-47ed-9c9b-df59cef1065f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20720e68-e886-41c8-95a9-8f9b861f1ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20720e68-e886-41c8-95a9-8f9b861f1ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c506772-7779-46aa-be3c-43d51fa1760b', 'volume_name': 'volume-2c506772-7779-46aa-be3c-43d51fa1760b', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd927617-4845-40fd-b477-5d64f4182716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd927617-4845-40fd-b477-5d64f4182716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbb69d7-fe44-4ce8-a646-db54e9d4fe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:52 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Volume 2c506772-7779-46aa-be3c-43d51fa1760b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c506772-7779-46aa-be3c-43d51fa1760b', 'volume_size': 1} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:25:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c506772-7779-46aa-be3c-43d51fa1760b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ebb39a0c90248a68b4231cb700874ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:25:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:25:53Z,use_quota=True,user_id='397ed31e1e68480d82d868555b22beab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Creating volume 2c506772-7779-46aa-be3c-43d51fa1760b {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:25:52 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-dee3541a-a1b1-4ff1-bf93-7c925577fded" acquired by "delete_volume" :: waited 0.067s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:52 devstack sudo[88346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b 1073741824 Apr 22 09:25:52 devstack sudo[88346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27026f0-4cb6-43b9-8809-d0e653b95554]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:52 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded Apr 22 09:25:52 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:53 devstack sudo[88346]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b 1073741824" returned: 0 in 0.629s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:53 devstack sudo[88357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b Apr 22 09:25:53 devstack sudo[88357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:53 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded" returned: 0 in 0.656s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:53 devstack sudo[88359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded Apr 22 09:25:53 devstack sudo[88359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:53 devstack sudo[88357]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b" returned: 0 in 0.467s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] <== create_volume: return (1124ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:25:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdbb69d7-fe44-4ce8-a646-db54e9d4fe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c506772-7779-46aa-be3c-43d51fa1760b', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8f29ce-a0b2-48e3-852a-655a46b87055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:53 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Volume volume-2c506772-7779-46aa-be3c-43d51fa1760b (2c506772-7779-46aa-be3c-43d51fa1760b): created successfully Apr 22 09:25:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8f29ce-a0b2-48e3-852a-655a46b87055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Flow 'volume_create_manager' (ff0e8812-f4e6-4e80-9698-fe16f192bf2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:53 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7e0abdb9-392c-4345-9940-ddc25a00a67d tempest-VolumesListAdminTestJSON-1409162707 None] Created volume successfully. Apr 22 09:25:54 devstack sudo[88359]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dee3541a-a1b1-4ff1-bf93-7c925577fded" returned: 0 in 0.550s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-dee3541a-a1b1-4ff1-bf93-7c925577fded" released by "delete_volume" :: held 1.232s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Created reservations ['562e7e35-197c-4202-a6a3-079954e5d32e', '25699d11-5c5b-4d5c-aacf-f6cf9dae4185', '33ca26aa-cca0-4e71-bc8b-a43e5313aad8', '02fd84a3-e79e-4aa0-a120-c7ef84234646'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:54 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:54 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:54 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.510s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:54 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Deleted volume successfully. Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c9a52ab2-af9a-4982-8a6f-9c90a9097983 tempest-VolumesGetTest-874813522 None] Lock "cinder-dee3541a-a1b1-4ff1-bf93-7c925577fded-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Acquiring lock "cinder-2c506772-7779-46aa-be3c-43d51fa1760b-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Lock "cinder-2c506772-7779-46aa-be3c-43d51fa1760b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-77b8497d-9abd-4271-bbad-3534fe5ca44d-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Acquiring lock "cinder-quobyte-2c506772-7779-46aa-be3c-43d51fa1760b" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Lock "cinder-77b8497d-9abd-4271-bbad-3534fe5ca44d-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Lock "cinder-quobyte-2c506772-7779-46aa-be3c-43d51fa1760b" acquired by "delete_volume" :: waited 0.026s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa85ab6f-ce45-4a7b-a216-d8fe8e19b7b1]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "cinder-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-quobyte-77b8497d-9abd-4271-bbad-3534fe5ca44d" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-77b8497d-9abd-4271-bbad-3534fe5ca44d" acquired by "delete_volume" :: waited 0.019s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[83baba60-952a-4a7a-807a-ad10137384eb]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:55 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b Apr 22 09:25:55 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "cinder-quobyte-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-quobyte-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2a0056-08bf-47bd-9444-a2b05e9df23b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:55 devstack sudo[88368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d Apr 22 09:25:55 devstack sudo[88368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:55 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9 Apr 22 09:25:55 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:55 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b" returned: 0 in 0.598s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:55 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b Apr 22 09:25:55 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:55 devstack sudo[88368]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d" returned: 0 in 0.586s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:55 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d Apr 22 09:25:55 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:55 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9" returned: 0 in 0.557s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:55 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9 Apr 22 09:25:55 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:56 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2c506772-7779-46aa-be3c-43d51fa1760b" returned: 0 in 0.651s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Lock "cinder-quobyte-2c506772-7779-46aa-be3c-43d51fa1760b" released by "delete_volume" :: held 1.288s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Created reservations ['f0152e62-f448-4200-836a-44830a3633f9', '98726ee2-4609-4eb8-bbf4-282ff7c94edd', '41380133-9f05-4da9-a7bf-15054ba9e546', 'b451bf99-1e82-4e63-9432-b8dca39f7c8e'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:56 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-77b8497d-9abd-4271-bbad-3534fe5ca44d" returned: 0 in 0.675s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-77b8497d-9abd-4271-bbad-3534fe5ca44d" released by "delete_volume" :: held 1.305s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Created reservations ['7e06ac3f-3be7-45eb-ac51-55532aa0aa4c', '20f7c6b3-5b0e-440d-b37b-42ba6690d214', 'eb9e0b43-0085-4720-92e5-afc62c281f17', 'fd488299-22dd-4586-a59a-9c602ab6a7c5'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:56 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9" returned: 0 in 0.719s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:56 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:56 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-quobyte-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9" released by "delete_volume" :: held 1.315s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Created reservations ['01a2dd44-154c-4178-888d-b681e2be8575', '54673ab4-76c6-438d-a6a4-b2a8e9b6ddbf', '5fe00e53-d942-4b37-8ce7-dd7ebfdd24d0', '25df1247-613b-4908-8cf6-820b9521da68'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:56 devstack sudo[88392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:56 devstack sudo[88392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:56 devstack sudo[88394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:56 devstack sudo[88394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:56 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.531s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:56 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Deleted volume successfully. Apr 22 09:25:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8f83b691-6f04-4e31-a118-0cee12606f95 tempest-VolumesListAdminTestJSON-1409162707 None] Lock "cinder-2c506772-7779-46aa-be3c-43d51fa1760b-delete_volume" released by "delete_volume" :: held 2.066s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:57 devstack sudo[88394]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.543s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:57 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Deleted volume successfully. Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-faa32035-bd48-4832-8ce8-a699bccfe3eb tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-75649fab-8e0a-4c97-9ac5-2b28ebb6edd9-delete_volume" released by "delete_volume" :: held 2.129s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-dd073d4a-f405-42a0-884b-70f6303daf07-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Lock "cinder-dd073d4a-f405-42a0-884b-70f6303daf07-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-quobyte-dd073d4a-f405-42a0-884b-70f6303daf07" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:57 devstack sudo[88392]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-dd073d4a-f405-42a0-884b-70f6303daf07" acquired by "delete_volume" :: waited 0.028s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.794s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:57 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Deleted volume successfully. Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5146eb7b-c799-43f1-bfcd-ada494ec20ee]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e351e3ed-08ae-4093-878a-93e82f470e10 tempest-VolumesGetTest-874813522 None] Lock "cinder-77b8497d-9abd-4271-bbad-3534fe5ca44d-delete_volume" released by "delete_volume" :: held 2.372s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "cinder-cd019be7-4c44-489e-b165-7731efb0d7f8-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-cd019be7-4c44-489e-b165-7731efb0d7f8-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:57 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 Apr 22 09:25:57 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "cinder-quobyte-cd019be7-4c44-489e-b165-7731efb0d7f8" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-quobyte-cd019be7-4c44-489e-b165-7731efb0d7f8" acquired by "delete_volume" :: waited 0.023s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9945f087-cabd-481c-a2d5-56ca6f4ee354]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:57 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8 Apr 22 09:25:57 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:57 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07" returned: 0 in 0.651s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:58 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07 Apr 22 09:25:58 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:58 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8" returned: 0 in 0.594s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:58 devstack sudo[88418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8 Apr 22 09:25:58 devstack sudo[88418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:58 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dd073d4a-f405-42a0-884b-70f6303daf07" returned: 0 in 0.469s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-dd073d4a-f405-42a0-884b-70f6303daf07" released by "delete_volume" :: held 1.167s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Created reservations ['61677eb3-b087-496d-82b3-b186244bbdba', '976dee9e-cd84-4247-adc4-d5c49445c804', '9aa46d5a-2048-4c0e-b4c1-1c0cf70caba4', '158963fe-4c40-4c2d-a9ef-0b8f1049ef2c'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:58 devstack sudo[88418]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-cd019be7-4c44-489e-b165-7731efb0d7f8" returned: 0 in 0.447s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-quobyte-cd019be7-4c44-489e-b165-7731efb0d7f8" released by "delete_volume" :: held 1.077s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:58 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:58 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Created reservations ['ffac3aa3-27ce-4da1-89b2-e2cc4700992a', '09b8686e-c6d0-4f46-af01-687a063fc4b8', '3e7c6dde-edf9-4d64-9c49-4d61cd0003ba', '5be6d98e-b077-43c8-9048-960708b042c6'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:25:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:58 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:25:58 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:59 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.487s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:59 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Deleted volume successfully. Apr 22 09:25:59 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.420s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:25:59 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Deleted volume successfully. Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c7ebb39c-ff31-4e45-8959-a50059404aa8 tempest-VolumesGetTest-874813522 None] Lock "cinder-dd073d4a-f405-42a0-884b-70f6303daf07-delete_volume" released by "delete_volume" :: held 1.851s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8e3de8de-e47d-449c-b5fd-8b02bf58ca75 tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-cd019be7-4c44-489e-b165-7731efb0d7f8-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "cinder-a583620a-427d-49f4-a941-0f7201c72ec4-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-a583620a-427d-49f4-a941-0f7201c72ec4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "cinder-quobyte-a583620a-427d-49f4-a941-0f7201c72ec4" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-quobyte-a583620a-427d-49f4-a941-0f7201c72ec4" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee9f471-a52d-4f9e-b415-331cdd5a6544]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:25:59 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4 Apr 22 09:25:59 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (76bf132a-63f1-480f-a3b3-64f41237c608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff4d213-09cd-44a8-ba70-73488abde66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ff4d213-09cd-44a8-ba70-73488abde66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1845478019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b10734-9bb5-4dc5-9c40-f19d326eadf7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:00Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5dbcff-5a5b-42b1-bb29-b9777393acd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5dbcff-5a5b-42b1-bb29-b9777393acd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3ce368-b90c-420e-b5aa-3fdfb7793f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:25:59 devstack cinder-volume[82642]: DEBUG cinder.image.glance [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Creating Keystone auth plugin from conf {{(pid=82642) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d3ce368-b90c-420e-b5aa-3fdfb7793f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14b10734-9bb5-4dc5-9c40-f19d326eadf7', 'volume_name': 'volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b660fb6f-8c10-48b1-a07d-c092bc79d106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b660fb6f-8c10-48b1-a07d-c092bc79d106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b33488-6db9-4554-a8aa-d067ffa81528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:00 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Volume 14b10734-9bb5-4dc5-9c40-f19d326eadf7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Trying to clone 14b10734-9bb5-4dc5-9c40-f19d326eadf7 from image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]). {{(pid=82642) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 09:26:00 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4" returned: 0 in 0.549s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:00 devstack sudo[88434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4 Apr 22 09:26:00 devstack sudo[88434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:736}} Apr 22 09:26:00 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Image download 20.69 MB at 20.69 MB/s Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90bb8f7-4ba9-45cd-9532-ff52bf49fcda]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:00 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD Apr 22 09:26:00 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:00 devstack sudo[88434]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a583620a-427d-49f4-a941-0f7201c72ec4" returned: 0 in 0.465s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-quobyte-a583620a-427d-49f4-a941-0f7201c72ec4" released by "delete_volume" :: held 1.040s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Created reservations ['dd696d93-83c5-40fb-ac28-db7f6210ddeb', 'cab58b3e-1756-4d90-8d84-c17c0c19cfc1', 'ed9ae6f9-8195-48fa-9984-2ecd4ab672b3', '326498e5-fddd-4049-a33d-c1f7a0cbb7c6'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:00 devstack sudo[88443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:26:00 devstack sudo[88443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:00 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD" returned: 0 in 0.484s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Temporary image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b is fetched for user bd46ae5ebb05492b88a91c1c6121bff4. {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:1439}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ebe6e85-aab9-4ce9-a2d2-9ce7b511e7fb]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:00 devstack sudo[88445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD Apr 22 09:26:00 devstack sudo[88445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:01 devstack sudo[88443]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.439s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:26:01 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Deleted volume successfully. Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e7876fe6-14d7-4384-ba7a-501ce7abc9dd tempest-VolumesListAdminTestJSON-1214508794 None] Lock "cinder-a583620a-427d-49f4-a941-0f7201c72ec4-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:01 devstack sudo[88445]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD" returned: 0 in 0.477s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1845478019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b10734-9bb5-4dc5-9c40-f19d326eadf7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:00Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Creating volume 14b10734-9bb5-4dc5-9c40-f19d326eadf7 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:26:01 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:01 devstack sudo[88452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 1073741824 Apr 22 09:26:01 devstack sudo[88452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:01 devstack sudo[88452]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 1073741824" returned: 0 in 0.599s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:02 devstack sudo[88457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 Apr 22 09:26:02 devstack sudo[88457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:02 devstack sudo[88457]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7" returned: 0 in 0.551s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:26:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:02 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Attempting download of 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b ((None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}])) to volume 14b10734-9bb5-4dc5-9c40-f19d326eadf7. {{(pid=82642) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 22 09:26:02 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[31642cc0-1260-4334-9218-33c0b9e5f733]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_j9u12m8c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:02 devstack sudo[88460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_j9u12m8c Apr 22 09:26:02 devstack sudo[88460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:03 devstack sudo[88460]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_j9u12m8c" returned: 0 in 0.717s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_j9u12m8c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:03 devstack sudo[88464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_j9u12m8c Apr 22 09:26:03 devstack sudo[88464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:03 devstack sudo[88464]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_j9u12m8c" returned: 1 in 0.617s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_j9u12m8c' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:26:03 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ee9200-6323-4b5c-9755-9058ccf3ea73]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:04 devstack sudo[88475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD Apr 22 09:26:04 devstack sudo[88475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:04 devstack sudo[88475]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD" returned: 0 in 0.724s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:04 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b was qcow2, converting to raw {{(pid=82642) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1126}} Apr 22 09:26:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:04 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 Apr 22 09:26:04 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Flow 'volume_create_manager' (48e0c123-69ca-47ce-8401-c5aadd11e863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204154f7-e89c-4c06-beb5-2e8fd6eaeab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (204154f7-e89c-4c06-beb5-2e8fd6eaeab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1935224091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b9226a-54df-4955-b4cb-2d6a84edba71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc7a050b9d846d8b6ade3b8cff354df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:05Z,use_quota=True,user_id='685c85170ebd43e4913df38e66909f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6633751e-9624-4e69-bccf-810ec55ed96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6633751e-9624-4e69-bccf-810ec55ed96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8770b4-ab44-4cfd-be30-e903020301f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.image.glance [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Creating Keystone auth plugin from conf {{(pid=82642) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8770b4-ab44-4cfd-be30-e903020301f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c6b9226a-54df-4955-b4cb-2d6a84edba71', 'volume_name': 'volume-c6b9226a-54df-4955-b4cb-2d6a84edba71', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a2bb00-b8c4-46e5-a73b-fec3c69961cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8a2bb00-b8c4-46e5-a73b-fec3c69961cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb995274-b016-4056-b05e-e1b1988971d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:05 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Volume c6b9226a-54df-4955-b4cb-2d6a84edba71: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c6b9226a-54df-4955-b4cb-2d6a84edba71', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Trying to clone c6b9226a-54df-4955-b4cb-2d6a84edba71 from image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]). {{(pid=82642) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 09:26:05 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7" returned: 0 in 1.089s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_pqi5cd74devstack@QuobyteHD, size 112.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:26:05 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Converted 112.00 MB image at 102.76 MB/s Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:05 devstack sudo[88500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 1G Apr 22 09:26:05 devstack sudo[88500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:736}} Apr 22 09:26:05 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Image download 20.69 MB at 20.69 MB/s Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[42c92e0b-48be-4c5e-bce8-cf13d99b668c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:05 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD Apr 22 09:26:05 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:06 devstack sudo[88500]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 1G" returned: 0 in 0.539s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:06 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c65ba6-3df3-4a3b-9ed2-a9644d22c050]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:06 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD" returned: 0 in 0.533s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:06 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Temporary image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b is fetched for user 685c85170ebd43e4913df38e66909f1a. {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:1439}} Apr 22 09:26:06 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 Apr 22 09:26:06 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:06 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a96cd7-76a2-4d8f-bea9-ae80d5aaaf23]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:06 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD Apr 22 09:26:06 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:06 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7" returned: 0 in 0.564s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:07 devstack sudo[88531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 Apr 22 09:26:07 devstack sudo[88531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:07 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD" returned: 0 in 0.558s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1935224091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6b9226a-54df-4955-b4cb-2d6a84edba71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdc7a050b9d846d8b6ade3b8cff354df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:05Z,use_quota=True,user_id='685c85170ebd43e4913df38e66909f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Creating volume c6b9226a-54df-4955-b4cb-2d6a84edba71 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:26:07 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:07 devstack sudo[88535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 1073741824 Apr 22 09:26:07 devstack sudo[88535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:07 devstack sudo[88531]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7" returned: 1 in 0.544s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Downloaded image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b ((None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}])) to volume 14b10734-9bb5-4dc5-9c40-f19d326eadf7 successfully. {{(pid=82642) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Temporary image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b for user bd46ae5ebb05492b88a91c1c6121bff4 is deleted. {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:1443}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Marking volume 14b10734-9bb5-4dc5-9c40-f19d326eadf7 as bootable. {{(pid=82642) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Copying metadata from image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b to 14b10734-9bb5-4dc5-9c40-f19d326eadf7. {{(pid=82642) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Creating volume glance metadata for volume 14b10734-9bb5-4dc5-9c40-f19d326eadf7 backed by image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82642) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b33488-6db9-4554-a8aa-d067ffa81528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd5189d-f7d7-469a-8283-4b137e211d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:07 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Volume volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 (14b10734-9bb5-4dc5-9c40-f19d326eadf7): created successfully Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd5189d-f7d7-469a-8283-4b137e211d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (76bf132a-63f1-480f-a3b3-64f41237c608) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:07 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-731fc1db-53ba-4846-b7a3-77164a78ce69 tempest-VolumesGetTest-874813522 None] Created volume successfully. Apr 22 09:26:07 devstack sudo[88535]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 1073741824" returned: 0 in 0.572s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:07 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 Apr 22 09:26:07 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:08 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71" returned: 0 in 0.424s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Attempting download of 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b ((None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}])) to volume c6b9226a-54df-4955-b4cb-2d6a84edba71. {{(pid=82642) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2702bc0-e1a7-43aa-a034-e61534003dc5]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_fc84ydzs {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:08 devstack sudo[88555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_fc84ydzs Apr 22 09:26:08 devstack sudo[88555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:08 devstack sudo[88555]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_fc84ydzs" returned: 0 in 0.594s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_fc84ydzs {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (2848757d-7f59-452e-8422-b3415ed7865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a5cf32-197d-42f3-84de-43b873236ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:08 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_fc84ydzs Apr 22 09:26:08 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a5cf32-197d-42f3-84de-43b873236ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1855574349',display_name='tempest-VolumesGetTest-Volume-2049068598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:09Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beee9991-899f-42dd-852e-9f7fb224ff3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (beee9991-899f-42dd-852e-9f7fb224ff3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1291f9-48e2-4e9a-bcf7-3a7c585eb604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e1291f9-48e2-4e9a-bcf7-3a7c585eb604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd90ce8ec-563e-43f8-8d92-f26fa0eb1ffb', 'volume_name': 'volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fc7c83-8180-49a3-b5bc-1cee31bd695c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72fc7c83-8180-49a3-b5bc-1cee31bd695c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f033cc-18a2-4cb0-b42c-bca8b0697ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:08 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Volume d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb', 'volume_size': 1} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1855574349',display_name='tempest-VolumesGetTest-Volume-2049068598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0edb084ded344fea9b5fe3a035eb0c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:09Z,use_quota=True,user_id='bd46ae5ebb05492b88a91c1c6121bff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Creating volume d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:26:08 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:26:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:08 devstack sudo[88561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb 1073741824 Apr 22 09:26:08 devstack sudo[88561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:09 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_fc84ydzs" returned: 1 in 0.454s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_fc84ydzs' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b283611c-42b3-4960-b4cf-8dc700c83321]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:09 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD Apr 22 09:26:09 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:09 devstack sudo[88561]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb 1073741824" returned: 0 in 0.540s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:09 devstack sudo[88573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb Apr 22 09:26:09 devstack sudo[88573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:09 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b was qcow2, converting to raw {{(pid=82642) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1126}} Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:09 devstack sudo[88581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 Apr 22 09:26:09 devstack sudo[88581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:09 devstack sudo[88573]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb" returned: 0 in 0.457s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59f033cc-18a2-4cb0-b42c-bca8b0697ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4c3155-7bf9-4b76-9018-60ebf8edd120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:09 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Volume volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb (d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb): created successfully Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4c3155-7bf9-4b76-9018-60ebf8edd120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Flow 'volume_create_manager' (2848757d-7f59-452e-8422-b3415ed7865a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:09 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d3cae3ee-14fe-4ab2-ac24-89b96c2f7cd5 tempest-VolumesGetTest-874813522 None] Created volume successfully. Apr 22 09:26:10 devstack sudo[88581]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71" returned: 0 in 0.928s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:10 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_cq5gp8hadevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:26:10 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Converted 112.00 MB image at 112.00 MB/s Apr 22 09:26:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:10 devstack sudo[88610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 1G Apr 22 09:26:10 devstack sudo[88610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Lock "cinder-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-quobyte-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:11 devstack sudo[88610]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 1G" returned: 0 in 0.483s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38ec3d9-50da-43f1-99f6-60a2b6b47f52]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[443cc813-2d38-407c-9b66-5975c908cb99]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:11 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 Apr 22 09:26:11 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:11 devstack sudo[88626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb Apr 22 09:26:11 devstack sudo[88626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:11 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71" returned: 0 in 0.639s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:11 devstack sudo[88667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 Apr 22 09:26:11 devstack sudo[88667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:11 devstack sudo[88626]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb" returned: 0 in 0.790s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:11 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb Apr 22 09:26:11 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:12 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb" returned: 0 in 0.552s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb" released by "delete_volume" :: held 1.395s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:12 devstack sudo[88667]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71" returned: 1 in 0.764s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Downloaded image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b ((None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}])) to volume c6b9226a-54df-4955-b4cb-2d6a84edba71 successfully. {{(pid=82642) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Temporary image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b for user 685c85170ebd43e4913df38e66909f1a is deleted. {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:1443}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Marking volume c6b9226a-54df-4955-b4cb-2d6a84edba71 as bootable. {{(pid=82642) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Created reservations ['1cea01f2-0476-4dc2-abef-4e0e1e3910a3', '4d0916ba-ef0a-43f5-b88b-fe381ca473d8', '7c8fc23e-88c8-467d-8927-a15f7f5072d0', 'a816ae9c-62a6-495d-a808-38738893005b'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Copying metadata from image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b to c6b9226a-54df-4955-b4cb-2d6a84edba71. {{(pid=82642) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Creating volume glance metadata for volume c6b9226a-54df-4955-b4cb-2d6a84edba71 backed by image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82642) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:12 devstack sudo[88706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:26:12 devstack sudo[88706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb995274-b016-4056-b05e-e1b1988971d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6b9226a-54df-4955-b4cb-2d6a84edba71', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b826ec54-c210-453e-b14d-e6c7a3cdced8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:12 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Volume volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 (c6b9226a-54df-4955-b4cb-2d6a84edba71): created successfully Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b826ec54-c210-453e-b14d-e6c7a3cdced8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Flow 'volume_create_manager' (48e0c123-69ca-47ce-8401-c5aadd11e863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:12 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6ced91e1-d924-4ed9-95fd-6d038de52d45 tempest-VolumesImageMetadata-1404492647 None] Created volume successfully. Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Acquiring lock "cinder-c6b9226a-54df-4955-b4cb-2d6a84edba71-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Lock "cinder-c6b9226a-54df-4955-b4cb-2d6a84edba71-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Acquiring lock "cinder-quobyte-c6b9226a-54df-4955-b4cb-2d6a84edba71" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Lock "cinder-quobyte-c6b9226a-54df-4955-b4cb-2d6a84edba71" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:13 devstack sudo[88706]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.551s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:26:13 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Deleted volume successfully. Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cee26fa6-b055-486d-ba4a-a8076e282ae9 tempest-VolumesGetTest-874813522 None] Lock "cinder-d90ce8ec-563e-43f8-8d92-f26fa0eb1ffb-delete_volume" released by "delete_volume" :: held 2.141s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2af529-cb33-497a-a458-42a731aa072b]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:13 devstack sudo[88710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 Apr 22 09:26:13 devstack sudo[88710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-14b10734-9bb5-4dc5-9c40-f19d326eadf7-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Lock "cinder-14b10734-9bb5-4dc5-9c40-f19d326eadf7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Acquiring lock "cinder-quobyte-14b10734-9bb5-4dc5-9c40-f19d326eadf7" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-14b10734-9bb5-4dc5-9c40-f19d326eadf7" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0873ebba-957b-4d5c-940d-7a9d2b4a315b]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:13 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 Apr 22 09:26:13 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:13 devstack sudo[88710]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71" returned: 0 in 0.720s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:14 devstack sudo[88718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 Apr 22 09:26:14 devstack sudo[88718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:14 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7" returned: 0 in 0.584s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:14 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 Apr 22 09:26:14 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:14 devstack sudo[88718]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71" returned: 1 in 0.671s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:26:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:14 devstack sudo[88729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71 Apr 22 09:26:14 devstack sudo[88729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:14 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7" returned: 1 in 0.634s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:26:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:14 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7 Apr 22 09:26:14 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (6b3e16e7-8e7a-498d-959b-6ef0db43cae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4f98b2-2480-44f9-888d-cc226fd2ebbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d4f98b2-2480-44f9-888d-cc226fd2ebbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-993073426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d870b7e8-84fc-4477-a63e-bffb385780ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:15Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70b2332-fe64-4e8a-8fae-aa308c3058e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f70b2332-fe64-4e8a-8fae-aa308c3058e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f2f5d1-5f04-44ea-87b1-309877a600ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f2f5d1-5f04-44ea-87b1-309877a600ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd870b7e8-84fc-4477-a63e-bffb385780ba', 'volume_name': 'volume-d870b7e8-84fc-4477-a63e-bffb385780ba', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7108c9ea-cee6-48f3-b94b-266550c5f700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7108c9ea-cee6-48f3-b94b-266550c5f700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a62f039-07fd-4fea-b26d-ddb631c27b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:15 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Volume d870b7e8-84fc-4477-a63e-bffb385780ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d870b7e8-84fc-4477-a63e-bffb385780ba', 'volume_size': 1} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-993073426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d870b7e8-84fc-4477-a63e-bffb385780ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:15Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Creating volume d870b7e8-84fc-4477-a63e-bffb385780ba {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:26:15 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:15 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba 1073741824 Apr 22 09:26:15 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:15 devstack sudo[88729]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c6b9226a-54df-4955-b4cb-2d6a84edba71" returned: 0 in 1.094s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Lock "cinder-quobyte-c6b9226a-54df-4955-b4cb-2d6a84edba71" released by "delete_volume" :: held 2.534s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:15 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-14b10734-9bb5-4dc5-9c40-f19d326eadf7" returned: 0 in 1.041s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Lock "cinder-quobyte-14b10734-9bb5-4dc5-9c40-f19d326eadf7" released by "delete_volume" :: held 2.309s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Created reservations ['027970d2-a748-4c70-a171-e214085a4713', '084b643b-6bf6-4648-8932-b2713b2626fc', '8d440ec1-da76-425a-9594-76729da48777', '21be696c-59a7-435c-82e2-0939da7d0a83'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Created reservations ['47c1e7d3-e57a-46fe-b076-10b47a134f14', 'b77d4cbb-0ba9-4656-b35c-4cb6ae22348a', '6552a10b-d63e-4e1a-9b0f-793f58410a1f', 'eb589896-f2a0-4c1f-841a-a42ca92ca565'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:15 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba 1073741824" returned: 0 in 0.669s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:15 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:26:15 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:15 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:26:15 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:15 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba Apr 22 09:26:15 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:16 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.592s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:26:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Deleted volume successfully. Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-54d3d336-3638-41d7-9db1-4d61f6132c4f tempest-VolumesImageMetadata-1404492647 None] Lock "cinder-c6b9226a-54df-4955-b4cb-2d6a84edba71-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:16 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba" returned: 0 in 0.683s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] <== create_volume: return (1405ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a62f039-07fd-4fea-b26d-ddb631c27b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d870b7e8-84fc-4477-a63e-bffb385780ba', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b631532-af5c-4184-8b2c-4bd4da78d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:16 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Volume volume-d870b7e8-84fc-4477-a63e-bffb385780ba (d870b7e8-84fc-4477-a63e-bffb385780ba): created successfully Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b631532-af5c-4184-8b2c-4bd4da78d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (6b3e16e7-8e7a-498d-959b-6ef0db43cae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0508c81b-25ca-4710-aab2-8026e11adb44 tempest-VolumesActionsTest-1597940252 None] Acquiring lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" by "attach_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b2049e43-34ae-432f-9a30-76d3ce9092d4 tempest-VolumesActionsTest-813773968 None] Created volume successfully. Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0508c81b-25ca-4710-aab2-8026e11adb44 tempest-VolumesActionsTest-1597940252 None] Lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" acquired by "attach_volume" :: waited 0.038s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0508c81b-25ca-4710-aab2-8026e11adb44 tempest-VolumesActionsTest-1597940252 None] Attaching volume 9cb546f0-ed2a-4c36-bf14-cccaaff979d3 to instance 208b25b6-c59c-4a8f-a149-c843e243b74f at mountpoint /dev/vdb on host None. Apr 22 09:26:16 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0508c81b-25ca-4710-aab2-8026e11adb44 tempest-VolumesActionsTest-1597940252 None] Attach volume completed successfully. Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.935s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0508c81b-25ca-4710-aab2-8026e11adb44 tempest-VolumesActionsTest-1597940252 None] Lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" released by "attach_volume" :: held 0.124s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Deleted volume successfully. Apr 22 09:26:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d9f1bb58-ad05-4ca6-afb5-503f6b86742f tempest-VolumesGetTest-874813522 None] Lock "cinder-14b10734-9bb5-4dc5-9c40-f19d326eadf7-delete_volume" released by "delete_volume" :: held 3.500s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8666b4e6-6bca-42be-88d1-c3fd1dd850e3 tempest-VolumesActionsTest-813773968 None] Acquiring lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba" by "attach_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8666b4e6-6bca-42be-88d1-c3fd1dd850e3 tempest-VolumesActionsTest-813773968 None] Lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba" acquired by "attach_volume" :: waited 0.018s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-04ddab9d-0acf-49e2-821c-c0c5f41fbe31 tempest-VolumesActionsTest-1597940252 None] Acquiring lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3-detach_volume" by "detach_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-04ddab9d-0acf-49e2-821c-c0c5f41fbe31 tempest-VolumesActionsTest-1597940252 None] Lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-04ddab9d-0acf-49e2-821c-c0c5f41fbe31 tempest-VolumesActionsTest-1597940252 None] Detaching volume 9cb546f0-ed2a-4c36-bf14-cccaaff979d3 from instance 208b25b6-c59c-4a8f-a149-c843e243b74f. Apr 22 09:26:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-8666b4e6-6bca-42be-88d1-c3fd1dd850e3 tempest-VolumesActionsTest-813773968 None] Attaching volume d870b7e8-84fc-4477-a63e-bffb385780ba to instance 324dbddc-ff5c-4ecc-a4a3-321c7098e8da at mountpoint /dev/vdb on host None. Apr 22 09:26:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-8666b4e6-6bca-42be-88d1-c3fd1dd850e3 tempest-VolumesActionsTest-813773968 None] Attach volume completed successfully. Apr 22 09:26:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8666b4e6-6bca-42be-88d1-c3fd1dd850e3 tempest-VolumesActionsTest-813773968 None] Lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba" released by "attach_volume" :: held 0.146s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-04ddab9d-0acf-49e2-821c-c0c5f41fbe31 tempest-VolumesActionsTest-1597940252 None] Detach volume completed successfully. Apr 22 09:26:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-04ddab9d-0acf-49e2-821c-c0c5f41fbe31 tempest-VolumesActionsTest-1597940252 None] Lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3-detach_volume" released by "detach_volume" :: held 0.135s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:18 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7d37946c-d2fe-45a3-8bdc-52dbfbe89489 tempest-VolumesActionsTest-1438487981 None] Terminate volume connection completed successfully. Apr 22 09:26:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7d37946c-d2fe-45a3-8bdc-52dbfbe89489 tempest-VolumesActionsTest-1438487981 None] Acquiring lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba-detach_volume" by "detach_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7d37946c-d2fe-45a3-8bdc-52dbfbe89489 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba-detach_volume" acquired by "detach_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:19 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7d37946c-d2fe-45a3-8bdc-52dbfbe89489 tempest-VolumesActionsTest-1438487981 None] Detaching volume d870b7e8-84fc-4477-a63e-bffb385780ba from instance 324dbddc-ff5c-4ecc-a4a3-321c7098e8da. Apr 22 09:26:19 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7d37946c-d2fe-45a3-8bdc-52dbfbe89489 tempest-VolumesActionsTest-1438487981 None] Detach volume completed successfully. Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7d37946c-d2fe-45a3-8bdc-52dbfbe89489 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba-detach_volume" released by "detach_volume" :: held 0.044s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Flow 'volume_create_manager' (6bd31a9f-73a2-4d41-880c-3531c975c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e026418-fcf4-4b50-a125-b07ab1596ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e026418-fcf4-4b50-a125-b07ab1596ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-90720332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269949ce-0e8e-4e9b-b748-f0f0d9ec28c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adac5e5087a4236b7f0139f21a53a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:19Z,use_quota=True,user_id='155cd5bc9aa34223b6249d979d50e14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d9a789-9d2e-4c1f-8cb7-ee12090f640e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d9a789-9d2e-4c1f-8cb7-ee12090f640e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c56d18-2b97-42e3-b8ac-3a63775aa6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c56d18-2b97-42e3-b8ac-3a63775aa6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '269949ce-0e8e-4e9b-b748-f0f0d9ec28c5', 'volume_name': 'volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1f29b3-75ef-49fd-a3a8-d8d9fdf996c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc1f29b3-75ef-49fd-a3a8-d8d9fdf996c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603ea7f3-12f7-4530-bce5-7ce1dd0c0523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:19 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Volume 269949ce-0e8e-4e9b-b748-f0f0d9ec28c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5', 'volume_size': 1} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-90720332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=269949ce-0e8e-4e9b-b748-f0f0d9ec28c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adac5e5087a4236b7f0139f21a53a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:19Z,use_quota=True,user_id='155cd5bc9aa34223b6249d979d50e14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Creating volume 269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:26:19 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:19 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 1073741824 Apr 22 09:26:19 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Flow 'volume_create_manager' (d8b1aadd-73a5-4a46-b381-9aab28697ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19b050a-3345-4e6c-9125-27690be36ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19b050a-3345-4e6c-9125-27690be36ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1676982402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ac824b-2837-4038-8343-48754b83ead4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1607478f500645eca888a2f9d0b2f8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:20Z,use_quota=True,user_id='ffb588509fa64d24bfe95db62dd1ad87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d85bd1-e064-425e-b51f-ce416a2feca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47d85bd1-e064-425e-b51f-ce416a2feca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823d4952-e98b-47e8-926d-b0dc0fe8b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823d4952-e98b-47e8-926d-b0dc0fe8b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ac824b-2837-4038-8343-48754b83ead4', 'volume_name': 'volume-72ac824b-2837-4038-8343-48754b83ead4', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2942d8a5-2f79-4cd8-895a-9f1205b38043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2942d8a5-2f79-4cd8-895a-9f1205b38043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2958fe-afce-418b-ac6b-814ce6acbe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:19 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Volume 72ac824b-2837-4038-8343-48754b83ead4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ac824b-2837-4038-8343-48754b83ead4', 'volume_size': 1} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2acff9a5-2eb8-4c1c-ac81-f9b2bc05b6fb tempest-VolumesActionsTest-813773968 None] Acquiring lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba-detach_volume" by "detach_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2acff9a5-2eb8-4c1c-ac81-f9b2bc05b6fb tempest-VolumesActionsTest-813773968 None] Lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba-detach_volume" acquired by "detach_volume" :: waited 0.029s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:19 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-2acff9a5-2eb8-4c1c-ac81-f9b2bc05b6fb tempest-VolumesActionsTest-813773968 None] Volume detach called, but volume not attached. Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2acff9a5-2eb8-4c1c-ac81-f9b2bc05b6fb tempest-VolumesActionsTest-813773968 None] Lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba-detach_volume" released by "detach_volume" :: held 0.033s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:20 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 1073741824" returned: 0 in 0.733s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:20 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 Apr 22 09:26:20 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Acquiring lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:20 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" returned: 0 in 0.458s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1676982402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ac824b-2837-4038-8343-48754b83ead4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1607478f500645eca888a2f9d0b2f8b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:20Z,use_quota=True,user_id='ffb588509fa64d24bfe95db62dd1ad87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Creating volume 72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:26:20 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:20 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 1073741824 Apr 22 09:26:20 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Acquiring lock "cinder-quobyte-d870b7e8-84fc-4477-a63e-bffb385780ba" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603ea7f3-12f7-4530-bce5-7ce1dd0c0523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d85257-9c50-4dbe-915e-fb7ac7b726f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:20 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Volume volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 (269949ce-0e8e-4e9b-b748-f0f0d9ec28c5): created successfully Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d85257-9c50-4dbe-915e-fb7ac7b726f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Flow 'volume_create_manager' (6bd31a9f-73a2-4d41-880c-3531c975c69a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Lock "cinder-quobyte-d870b7e8-84fc-4477-a63e-bffb385780ba" acquired by "delete_volume" :: waited 0.034s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:20 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f0abae0f-25cb-4ad4-bd75-d317db023dc1 tempest-VolumesDeleteCascade-1823056562 None] Created volume successfully. Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7886e87-6f94-4c7a-8b98-04d9095886b1]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:20 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba Apr 22 09:26:20 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:21 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 1073741824" returned: 0 in 0.628s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:21 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:21 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 Apr 22 09:26:21 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba" returned: 0 in 0.583s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:21 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba Apr 22 09:26:21 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:21 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4" returned: 0 in 0.535s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] <== create_volume: return (1190ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2958fe-afce-418b-ac6b-814ce6acbe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ac824b-2837-4038-8343-48754b83ead4', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603f1f35-ce5c-43b8-98e1-51580613a929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:21 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Volume volume-72ac824b-2837-4038-8343-48754b83ead4 (72ac824b-2837-4038-8343-48754b83ead4): created successfully Apr 22 09:26:21 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (603f1f35-ce5c-43b8-98e1-51580613a929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Flow 'volume_create_manager' (d8b1aadd-73a5-4a46-b381-9aab28697ea2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d870b7e8-84fc-4477-a63e-bffb385780ba" returned: 0 in 0.605s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:21 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-db567b5c-419b-4777-9f17-3746bdb42859 tempest-VolumesSnapshotListTestJSON-826383756 None] Created volume successfully. Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Lock "cinder-quobyte-d870b7e8-84fc-4477-a63e-bffb385780ba" released by "delete_volume" :: held 1.228s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] Creating offline snapshot dde0ff20-104f-4afb-b10e-5ed0a691409c of volume 269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccd1694-5d08-474f-9042-0a2b20fff201]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:21 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Created reservations ['d090d9cf-5b59-46eb-bfa8-235079633046', 'eb46b149-f2ea-495a-a6a0-e5bfe249da73', 'a62f5ed7-8bd8-43cd-8d63-d344057dde50', '98bde559-2fde-44bc-8cae-15892f5ddc7b'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:26:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:22 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:26:22 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:22 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 Apr 22 09:26:22 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:22 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:22 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.485s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:22 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:26:22 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Deleted volume successfully. Apr 22 09:26:22 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c 1G Apr 22 09:26:22 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0ea8f830-c00b-48fc-a38d-609966eeda38 tempest-VolumesActionsTest-813773968 None] Lock "cinder-d870b7e8-84fc-4477-a63e-bffb385780ba-delete_volume" released by "delete_volume" :: held 1.936s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:23 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c 1G" returned: 0 in 0.648s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:23 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c Apr 22 09:26:23 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:23 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c" returned: 0 in 0.458s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:23 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c is being set with open permissions: ugo+rw Apr 22 09:26:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:23 devstack sudo[88827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c Apr 22 09:26:23 devstack sudo[88827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:24 devstack sudo[88827]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c" returned: 0 in 0.424s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:24 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.info Apr 22 09:26:24 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:24 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.info" returned: 0 in 0.495s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:24 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.info is being set with open permissions: ugo+rw Apr 22 09:26:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:24 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.info Apr 22 09:26:24 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:24 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.info" returned: 0 in 0.388s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.020s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.819s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:24 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-11d1ebd3-b35e-4546-bd54-cca3592bad24 tempest-VolumesDeleteCascade-1823056562 None] Create snapshot completed successfully Apr 22 09:26:24 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] Creating offline snapshot cecf94e9-7ed3-433c-8b2d-8b96e11211b5 of volume 72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:26:25 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f33ab17-e9da-4da0-ac7d-506ac2f95d0a]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:25 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 Apr 22 09:26:25 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:25 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4" returned: 0 in 0.480s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:25 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 1G Apr 22 09:26:25 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:26 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 1G" returned: 0 in 0.602s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ac824b-2837-4038-8343-48754b83ead4 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:26 devstack sudo[88882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ac824b-2837-4038-8343-48754b83ead4 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 Apr 22 09:26:26 devstack sudo[88882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:26 devstack sudo[88882]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ac824b-2837-4038-8343-48754b83ead4 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5" returned: 0 in 0.522s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:26 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 is being set with open permissions: ugo+rw Apr 22 09:26:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:26 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 Apr 22 09:26:26 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:27 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5" returned: 0 in 0.447s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:27 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.info Apr 22 09:26:27 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:27 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.info" returned: 0 in 0.416s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:27 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.info is being set with open permissions: ugo+rw Apr 22 09:26:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:27 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.info Apr 22 09:26:27 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:27 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.info" returned: 0 in 0.418s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.946s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.743s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] Creating offline snapshot ecdf81a5-5008-40d6-a0c7-2dd95263b200 of volume 269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:26:27 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-a1603276-8b6e-4157-9f03-d01e09ceaa86 tempest-VolumesSnapshotListTestJSON-826383756 None] Create snapshot completed successfully Apr 22 09:26:27 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7386de-5b68-4d9d-846f-dd61c972e90f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:28 devstack sudo[88897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c Apr 22 09:26:28 devstack sudo[88897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:28 devstack sudo[88897]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c" returned: 0 in 0.503s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:26:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:28 devstack sudo[88902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 1G Apr 22 09:26:28 devstack sudo[88902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:28 devstack sudo[88902]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 1G" returned: 0 in 0.509s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:29 devstack sudo[88907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 Apr 22 09:26:29 devstack sudo[88907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:29 devstack sudo[88907]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200" returned: 0 in 0.414s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:29 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 is being set with open permissions: ugo+rw Apr 22 09:26:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:29 devstack sudo[88912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 Apr 22 09:26:29 devstack sudo[88912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:29 devstack sudo[88912]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200" returned: 0 in 0.409s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.896s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.953s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:29 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[329ca3c5-d0b5-4fcf-9aa6-389eedcd45e3]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:29 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-5b54a2a4-31b0-4c6f-9eda-b10bcc2949e5 tempest-VolumesDeleteCascade-1823056562 None] Create snapshot completed successfully Apr 22 09:26:29 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 Apr 22 09:26:29 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:30 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" returned: 0 in 0.483s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5b6985-1169-4889-b16a-d08e49c53695]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:UPDATE=156,cinder:SELECT=166,cinder:INSERT=58,cinder:DELETE=16 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Performing cascade delete. {{(pid=82642) delete_volume /opt/stack/cinder/cinder/volume/manager.py:998}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-dde0ff20-104f-4afb-b10e-5ed0a691409c-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-dde0ff20-104f-4afb-b10e-5ed0a691409c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:30 devstack sudo[88920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 Apr 22 09:26:30 devstack sudo[88920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-quobyte-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-quobyte-dde0ff20-104f-4afb-b10e-5ed0a691409c" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-dde0ff20-104f-4afb-b10e-5ed0a691409c" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Deleting offline snapshot dde0ff20-104f-4afb-b10e-5ed0a691409c of volume 269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] snapshot_file for this snap is: volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[421704af-a438-4682-8ab8-9375b27c6d73]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:30 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c Apr 22 09:26:30 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_service.periodic_task [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:30 devstack sudo[88924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:26:30 devstack sudo[88924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:30 devstack sudo[88920]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" returned: 0 in 0.502s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.90488245-8486-4b43-9db0-38d5fff57c84heylef0g.img {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:30 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.90488245-8486-4b43-9db0-38d5fff57c84heylef0g.img Apr 22 09:26:30 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:30 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c" returned: 0 in 0.460s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1753a7-da9c-4e55-bee9-2686c1ef29df]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:30 devstack sudo[88934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 Apr 22 09:26:30 devstack sudo[88934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:31 devstack sudo[88924]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.415s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:26:31 devstack sudo[88934]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" returned: 0 in 0.767s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af73e60-a301-4ad3-bf07-f8ae0d92bd89]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=118,cinder:INSERT=44,cinder:UPDATE=173,cinder:DELETE=14 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (61c20976-9614-41b6-ba47-0097bf13bae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48f8f2d-33a0-49fc-ad22-fbea06e9be4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f48f8f2d-33a0-49fc-ad22-fbea06e9be4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1883198963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c20539a-13d0-4e80-8935-f8c6552407d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:32Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789e2997-9559-4181-ae47-405d65caf256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (789e2997-9559-4181-ae47-405d65caf256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80ffcf0-a28a-4591-9710-0da675aec055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b80ffcf0-a28a-4591-9710-0da675aec055) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c20539a-13d0-4e80-8935-f8c6552407d8', 'volume_name': 'volume-4c20539a-13d0-4e80-8935-f8c6552407d8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befd4fb0-d043-48be-ac06-86c5eb97d18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:31 devstack sudo[88951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 Apr 22 09:26:31 devstack sudo[88951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (befd4fb0-d043-48be-ac06-86c5eb97d18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d793d4-b22f-4bd7-82cc-c975cfeb077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:31 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Volume 4c20539a-13d0-4e80-8935-f8c6552407d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c20539a-13d0-4e80-8935-f8c6552407d8', 'volume_size': 1} Apr 22 09:26:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:32 devstack sudo[88951]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200" returned: 0 in 1.105s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:26:32 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71a56bc-e29b-41af-bb86-e73f94d7e82f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:32 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.90488245-8486-4b43-9db0-38d5fff57c84heylef0g.img" returned: 0 in 2.079s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:32 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1441ff9a-834b-4431-b3af-730d44ff9cac]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:32 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c Apr 22 09:26:32 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:32 devstack sudo[88963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 Apr 22 09:26:32 devstack sudo[88963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:33 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c" returned: 0 in 0.455s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:26:33 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82e1025-304a-403f-be38-f250ef67c9f8]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:33 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 Apr 22 09:26:33 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:33 devstack sudo[88963]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" returned: 0 in 0.574s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:33 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3, size 1024.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.90488245-8486-4b43-9db0-38d5fff57c84heylef0g.img {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:26:33 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] Converted 1024.00 MB image at 492.22 MB/s Apr 22 09:26:33 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] 90488245-8486-4b43-9db0-38d5fff57c84 was raw, no need to convert to raw {{(pid=82642) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1165}} Apr 22 09:26:33 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" returned: 0 in 0.490s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:33 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c Apr 22 09:26:33 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:34 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c" returned: 0 in 0.473s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:34 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c Apr 22 09:26:34 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:34 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.dde0ff20-104f-4afb-b10e-5ed0a691409c" returned: 0 in 0.417s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 -F qcow2 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:34 devstack sudo[88985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 -F qcow2 Apr 22 09:26:34 devstack sudo[88985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:35 devstack sudo[88985]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 -F qcow2" returned: 0 in 0.508s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-dde0ff20-104f-4afb-b10e-5ed0a691409c" released by "_delete_snapshot" :: held 4.806s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" released by "delete_snapshot" :: held 4.819s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Created reservations ['804203c3-e902-44bc-abe6-ccfa2e6b30c2', '453ded0a-0d3b-40d2-bc05-4007de843505', '7c777523-ef4e-4d91-bfd6-54daa40ff967', 'e435bc8e-3cb4-4ad6-89e9-34bef6e0e32b'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:26:35 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Delete snapshot completed successfully. Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-dde0ff20-104f-4afb-b10e-5ed0a691409c-delete_snapshot" released by "delete_snapshot" :: held 4.940s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-ecdf81a5-5008-40d6-a0c7-2dd95263b200-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-ecdf81a5-5008-40d6-a0c7-2dd95263b200-delete_snapshot" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-quobyte-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-quobyte-ecdf81a5-5008-40d6-a0c7-2dd95263b200" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-ecdf81a5-5008-40d6-a0c7-2dd95263b200" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Deleting offline snapshot ecdf81a5-5008-40d6-a0c7-2dd95263b200 of volume 269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] snapshot_file for this snap is: volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58518c4-3a30-4a5a-981f-fcc8adcc4a1c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:35 devstack sudo[88990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 Apr 22 09:26:35 devstack sudo[88990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:35 devstack sudo[88990]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200" returned: 0 in 0.495s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0531c46c-8380-47f2-9e8a-834e18d9ea81]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:36 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 Apr 22 09:26:36 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:36 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:36 devstack sudo[89000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 Apr 22 09:26:36 devstack sudo[89000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:36 devstack sudo[89000]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200" returned: 0 in 0.548s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:37 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200 Apr 22 09:26:37 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:37 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5.ecdf81a5-5008-40d6-a0c7-2dd95263b200" returned: 0 in 0.439s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-ecdf81a5-5008-40d6-a0c7-2dd95263b200" released by "_delete_snapshot" :: held 2.058s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" released by "delete_snapshot" :: held 2.070s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:37 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Created reservations ['9eafe4d1-339d-441f-8023-4e19277f12ff', 'fdeb8660-24d1-4576-a641-855ef230ca88', 'cad7a268-8aaf-46d1-b3f2-5c22667a1987', 'ae253da7-4fd7-4372-8c60-61c880998fe2'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:26:37 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Delete snapshot completed successfully. Apr 22 09:26:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-ecdf81a5-5008-40d6-a0c7-2dd95263b200-delete_snapshot" released by "delete_snapshot" :: held 2.185s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Snapshots deleted, issuing volume delete {{(pid=82642) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1013}} Apr 22 09:26:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-quobyte-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" acquired by "delete_volume" :: waited 0.006s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:37 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5092d53-a8ed-4bb1-b903-bfc1db74a895]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:37 devstack sudo[89008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 Apr 22 09:26:37 devstack sudo[89008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:38 devstack sudo[89008]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" returned: 0 in 0.641s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:38 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5 Apr 22 09:26:38 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:38 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" returned: 0 in 0.472s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:38 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5" released by "delete_volume" :: held 1.143s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:38 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Created reservations ['a118458f-6c8a-4760-8527-5c926a4efbb9', 'f801c043-f8d7-40db-a779-72abeb4b332c', '987e4412-2991-468c-b8d0-4adc202dce7f', '3826a6bb-a110-470f-81b4-c9ddc620fe2f'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:26:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:38 devstack sudo[89050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:26:38 devstack sudo[89050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:39 devstack sudo[89050]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.481s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:26:39 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Deleted volume successfully. Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d7a84b7b-192c-497c-9b80-acff8126c2e9 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-269949ce-0e8e-4e9b-b748-f0f0d9ec28c5-delete_volume" released by "delete_volume" :: held 8.923s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Flow 'volume_create_manager' (cad4c382-f43e-479b-8e70-7ecddee94afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515c404c-a0c7-4ee1-9e72-1a919f7761b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (515c404c-a0c7-4ee1-9e72-1a919f7761b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1684739982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e3e94e-5c26-493d-ac70-55e24f220d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adac5e5087a4236b7f0139f21a53a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:39Z,use_quota=True,user_id='155cd5bc9aa34223b6249d979d50e14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27e629b-3dfd-4e12-88e4-22c7a3469ff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b27e629b-3dfd-4e12-88e4-22c7a3469ff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b057bce4-b80d-4ad0-b00a-8473f6d66141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b057bce4-b80d-4ad0-b00a-8473f6d66141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42e3e94e-5c26-493d-ac70-55e24f220d3e', 'volume_name': 'volume-42e3e94e-5c26-493d-ac70-55e24f220d3e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbda882-ada2-43ff-bdcb-de18af241136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cbda882-ada2-43ff-bdcb-de18af241136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367c42f3-7092-475c-a19c-3930515c2a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:39 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Volume 42e3e94e-5c26-493d-ac70-55e24f220d3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42e3e94e-5c26-493d-ac70-55e24f220d3e', 'volume_size': 1} Apr 22 09:26:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.537s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:43 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] Uploaded volume to glance image-id: 90488245-8486-4b43-9db0-38d5fff57c84. {{(pid=82642) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1784}} Apr 22 09:26:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 14.943s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:43 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] Creating offline snapshot 2aab66c2-2052-411a-8990-4d076788b207 of volume 72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:26:43 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f24e549-db87-4526-ab6f-914bca28ff45]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:43 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-356b043d-cfac-4e9b-975e-b016c1820000 tempest-VolumesActionsTest-1597940252 None] Copy volume to image completed successfully. Apr 22 09:26:43 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 Apr 22 09:26:43 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:43 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5" returned: 0 in 0.458s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:43 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ac824b-2837-4038-8343-48754b83ead4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:26:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:43 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 1G Apr 22 09:26:43 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:44 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 1G" returned: 0 in 0.500s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:44 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 Apr 22 09:26:44 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:44 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207" returned: 0 in 0.457s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:44 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 is being set with open permissions: ugo+rw Apr 22 09:26:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:44 devstack sudo[89069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 Apr 22 09:26:44 devstack sudo[89069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:45 devstack sudo[89069]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207" returned: 0 in 0.422s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.893s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.276s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1883198963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c20539a-13d0-4e80-8935-f8c6552407d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:32Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Creating volume 4c20539a-13d0-4e80-8935-f8c6552407d8 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:26:45 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:45 devstack sudo[89072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8 1073741824 Apr 22 09:26:45 devstack sudo[89072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:45 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-dd1c9c85-7b7d-45bf-b75f-0f040d55eda3 tempest-VolumesSnapshotListTestJSON-826383756 None] Create snapshot completed successfully Apr 22 09:26:45 devstack sudo[89072]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8 1073741824" returned: 0 in 0.486s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:45 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8 Apr 22 09:26:45 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:46 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8" returned: 0 in 0.434s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.764s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1684739982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42e3e94e-5c26-493d-ac70-55e24f220d3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adac5e5087a4236b7f0139f21a53a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:39Z,use_quota=True,user_id='155cd5bc9aa34223b6249d979d50e14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Creating volume 42e3e94e-5c26-493d-ac70-55e24f220d3e {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:26:46 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d793d4-b22f-4bd7-82cc-c975cfeb077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c20539a-13d0-4e80-8935-f8c6552407d8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7222288-d6bb-4155-9e54-fa6f013eb11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:46 devstack sudo[89080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e 1073741824 Apr 22 09:26:46 devstack sudo[89080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:46 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Volume volume-4c20539a-13d0-4e80-8935-f8c6552407d8 (4c20539a-13d0-4e80-8935-f8c6552407d8): created successfully Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7222288-d6bb-4155-9e54-fa6f013eb11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (61c20976-9614-41b6-ba47-0097bf13bae4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:46 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-521cd4c0-8a46-4857-a3e8-f32caca6ce03 tempest-VolumesActionsTest-813773968 None] Created volume successfully. Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Acquiring lock "cinder-4c20539a-13d0-4e80-8935-f8c6552407d8-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-4c20539a-13d0-4e80-8935-f8c6552407d8-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Acquiring lock "cinder-quobyte-4c20539a-13d0-4e80-8935-f8c6552407d8" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-quobyte-4c20539a-13d0-4e80-8935-f8c6552407d8" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb2a728-d84f-471b-b00c-e9b7e55e69ec]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:46 devstack sudo[89085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8 Apr 22 09:26:46 devstack sudo[89085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:46 devstack sudo[89080]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e 1073741824" returned: 0 in 0.527s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:46 devstack sudo[89088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e Apr 22 09:26:46 devstack sudo[89088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:47 devstack sudo[89085]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8" returned: 0 in 0.464s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:47 devstack sudo[89094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8 Apr 22 09:26:47 devstack sudo[89094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:47 devstack sudo[89088]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e" returned: 0 in 0.424s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.299s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (367c42f3-7092-475c-a19c-3930515c2a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42e3e94e-5c26-493d-ac70-55e24f220d3e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba97f971-9c23-4c7a-9c6a-920902abba1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e460444-d235-4a9f-9e29-77022fe66f9f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:47 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Volume volume-42e3e94e-5c26-493d-ac70-55e24f220d3e (42e3e94e-5c26-493d-ac70-55e24f220d3e): created successfully Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba97f971-9c23-4c7a-9c6a-920902abba1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Flow 'volume_create_manager' (cad4c382-f43e-479b-8e70-7ecddee94afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:47 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7d816c58-bae8-4d58-a12b-4b62987902bf tempest-VolumesDeleteCascade-1823056562 None] Created volume successfully. Apr 22 09:26:47 devstack sudo[89096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 Apr 22 09:26:47 devstack sudo[89096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:47 devstack sudo[89094]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4c20539a-13d0-4e80-8935-f8c6552407d8" returned: 0 in 0.414s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-quobyte-4c20539a-13d0-4e80-8935-f8c6552407d8" released by "delete_volume" :: held 0.898s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Created reservations ['79482737-0d0c-437b-ad53-a36ecdf03111', 'df90f909-c2d5-46e0-8039-c85844dd2eba', '0ab86b5a-20bf-42f7-a8d6-630741d01e59', 'eaee5dee-16a6-44db-b80c-1344122bd083'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:47 devstack sudo[89102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:26:47 devstack sudo[89102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:47 devstack sudo[89096]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" returned: 0 in 0.486s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fcecff-6195-4492-ba67-fc9f6eb86e14]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:47 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 Apr 22 09:26:47 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (45884ea1-a5d1-4e9f-a463-2892500e828f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33fef1e2-467d-453d-9c4b-24763a9b5e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33fef1e2-467d-453d-9c4b-24763a9b5e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1915086265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff75c4f-002d-448b-b666-c65c24b61378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:48Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34de9e6d-011e-44a5-b4dd-838fa33106ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34de9e6d-011e-44a5-b4dd-838fa33106ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43d264c-e405-4c10-a393-875173a0ff77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b43d264c-e405-4c10-a393-875173a0ff77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff75c4f-002d-448b-b666-c65c24b61378', 'volume_name': 'volume-aff75c4f-002d-448b-b666-c65c24b61378', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:48 devstack sudo[89102]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b6a14b-a177-4b58-a64a-9400ad0dfc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92b6a14b-a177-4b58-a64a-9400ad0dfc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151f8caa-a2b9-4779-8908-e77efc21f977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:48 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Volume aff75c4f-002d-448b-b666-c65c24b61378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff75c4f-002d-448b-b666-c65c24b61378', 'volume_size': 1} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.469s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:26:48 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Deleted volume successfully. Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-dd076aa7-81ea-477f-bb5b-cb48d5a6faa1 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-4c20539a-13d0-4e80-8935-f8c6552407d8-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:48 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" returned: 0 in 0.530s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:48 devstack sudo[89111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img Apr 22 09:26:48 devstack sudo[89111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:50 devstack sudo[89111]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img" returned: 0 in 1.941s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:50 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb986c51-24d0-4cd2-bd35-c215548ea85a]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:50 devstack sudo[89123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 Apr 22 09:26:50 devstack sudo[89123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:50 devstack sudo[89123]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" returned: 0 in 0.578s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:50 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:26:50 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Converted 1024.00 MB image at 527.21 MB/s Apr 22 09:26:50 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] 1becbde7-f81c-480a-a43e-74b0ca7dfdf4 was raw, converting to qcow2 {{(pid=82642) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1182}} Apr 22 09:26:50 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b721385-c4f6-47ea-a630-15aa06b5a109]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:50 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img Apr 22 09:26:50 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:51 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img" returned: 0 in 0.499s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:51 devstack sudo[89133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img Apr 22 09:26:51 devstack sudo[89133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:51 devstack sudo[89133]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img" returned: 1 in 0.477s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:26:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img /opt/stack/data/cinder/conversion/vol_upload_pt70zuc_ {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:51 devstack sudo[89138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img /opt/stack/data/cinder/conversion/vol_upload_pt70zuc_ Apr 22 09:26:51 devstack sudo[89138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:52 devstack sudo[89138]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img /opt/stack/data/cinder/conversion/vol_upload_pt70zuc_" returned: 0 in 0.405s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:52 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Image conversion details: src /opt/stack/data/cinder/conversion/9cb546f0-ed2a-4c36-bf14-cccaaff979d3.temp_image.1becbde7-f81c-480a-a43e-74b0ca7dfdf48enmu1ph.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_pt70zuc_ {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:26:52 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 22 09:26:52 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c055fa5-9c37-4d0d-be6f-2791b3757153]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pt70zuc_ {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:52 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pt70zuc_ Apr 22 09:26:52 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:52 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_pt70zuc_" returned: 0 in 0.447s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.285s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Uploaded volume to glance image-id: 1becbde7-f81c-480a-a43e-74b0ca7dfdf4. {{(pid=82642) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1784}} Apr 22 09:26:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.284s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] Creating offline snapshot 5cc69977-f4df-4494-8d02-1d41d7d6b4e3 of volume 72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:26:53 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-3fc0b58c-a6c1-47b0-9354-5876cf0a8a70 tempest-VolumesActionsTest-1597940252 None] Copy volume to image completed successfully. Apr 22 09:26:53 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e6b2f4-3090-4420-afe8-4d7c260f0dff]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:53 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 Apr 22 09:26:53 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:53 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207" returned: 0 in 0.450s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ac824b-2837-4038-8343-48754b83ead4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:26:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:53 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 1G Apr 22 09:26:53 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:54 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 1G" returned: 0 in 0.562s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:54 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 Apr 22 09:26:54 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Acquiring lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Acquiring lock "cinder-quobyte-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Lock "cinder-quobyte-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:54 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae451867-d424-435c-8436-04b2a4ef2f36]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:54 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 Apr 22 09:26:54 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:54 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3" returned: 0 in 0.426s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:54 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 is being set with open permissions: ugo+rw Apr 22 09:26:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:54 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 Apr 22 09:26:54 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:55 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" returned: 0 in 0.479s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:55 devstack sudo[89170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3 Apr 22 09:26:55 devstack sudo[89170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:55 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3" returned: 0 in 0.423s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.412s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] Creating offline snapshot 39a96276-d455-4fb8-a75f-796d7b1da436 of volume 42e3e94e-5c26-493d-ac70-55e24f220d3e {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0f9b16-ffd9-4a32-b8fc-0fad1ff16bce]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:55 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0ecb7e22-8e8b-4b78-bad5-5ce5b9db51dc tempest-VolumesSnapshotListTestJSON-826383756 None] Create snapshot completed successfully Apr 22 09:26:55 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e Apr 22 09:26:55 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:55 devstack sudo[89170]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" returned: 0 in 0.431s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Lock "cinder-quobyte-9cb546f0-ed2a-4c36-bf14-cccaaff979d3" released by "delete_volume" :: held 0.931s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Created reservations ['f3fd2658-adaa-4810-a1a4-43ed3392f3b5', 'f7998b55-9164-4e98-be77-4498f5dee62a', 'eb0eb086-6a2c-4327-bc3f-797d9d64870e', '311fe6fe-9659-467e-9d81-e8a9a4dfa480'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:55 devstack sudo[89176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:26:55 devstack sudo[89176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:55 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e" returned: 0 in 0.496s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:55 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 1G Apr 22 09:26:55 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:56 devstack sudo[89176]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.474s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:56 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:26:56 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Deleted volume successfully. Apr 22 09:26:56 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b29fa3cf-162e-4c0a-9c0c-cb4a8e6afa01 tempest-VolumesActionsTest-1597940252 None] Lock "cinder-9cb546f0-ed2a-4c36-bf14-cccaaff979d3-delete_volume" released by "delete_volume" :: held 1.551s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:56 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 1G" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e3e94e-5c26-493d-ac70-55e24f220d3e -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:56 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e3e94e-5c26-493d-ac70-55e24f220d3e -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 Apr 22 09:26:56 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:56 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-42e3e94e-5c26-493d-ac70-55e24f220d3e -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436" returned: 0 in 0.484s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:56 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 is being set with open permissions: ugo+rw Apr 22 09:26:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:56 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 Apr 22 09:26:56 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "cinder-5cc69977-f4df-4494-8d02-1d41d7d6b4e3-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-5cc69977-f4df-4494-8d02-1d41d7d6b4e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "cinder-quobyte-5cc69977-f4df-4494-8d02-1d41d7d6b4e3" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-5cc69977-f4df-4494-8d02-1d41d7d6b4e3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Deleting offline snapshot 5cc69977-f4df-4494-8d02-1d41d7d6b4e3 of volume 72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] snapshot_file for this snap is: volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b9e33f8-9017-4db4-8539-a36ea7e32017]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:57 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 Apr 22 09:26:57 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:57 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436" returned: 0 in 0.456s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:57 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.info Apr 22 09:26:57 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:57 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3" returned: 0 in 0.583s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ac824b-2837-4038-8343-48754b83ead4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dddfce-483d-4121-94b4-5574d99e5ac7]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:57 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.info" returned: 0 in 0.431s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:57 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.info is being set with open permissions: ugo+rw Apr 22 09:26:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:57 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.info Apr 22 09:26:57 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:57 devstack sudo[89205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 Apr 22 09:26:57 devstack sudo[89205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:58 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.info" returned: 0 in 0.491s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.973s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.307s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1915086265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff75c4f-002d-448b-b666-c65c24b61378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:26:48Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Creating volume aff75c4f-002d-448b-b666-c65c24b61378 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:26:58 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:58 devstack sudo[89205]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:58 devstack sudo[89214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378 1073741824 Apr 22 09:26:58 devstack sudo[89214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207" returned: 0 in 0.592s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ac824b-2837-4038-8343-48754b83ead4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:58 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-98733151-b20d-4a49-874a-01ff348e35f0 tempest-VolumesDeleteCascade-1823056562 None] Create snapshot completed successfully Apr 22 09:26:58 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 Apr 22 09:26:58 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:58 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3" returned: 0 in 0.500s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:58 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3 Apr 22 09:26:58 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:59 devstack sudo[89214]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378 1073741824" returned: 0 in 0.621s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:59 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378 Apr 22 09:26:59 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:26:59 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.5cc69977-f4df-4494-8d02-1d41d7d6b4e3" returned: 0 in 0.503s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-5cc69977-f4df-4494-8d02-1d41d7d6b4e3" released by "_delete_snapshot" :: held 2.235s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" released by "delete_snapshot" :: held 2.249s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Created reservations ['45b2afbc-adab-4ac3-be35-fd0fbf21392e', '0138fe57-a8a0-47dc-ba8c-7c9d918ec25d', '3798b792-5c38-4fcb-9b7b-dfca9a594c52', '59017d28-9a4b-4771-ba61-ab853fa47a45'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:26:59 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378" returned: 0 in 0.523s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] <== create_volume: return (1175ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.178s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (151f8caa-a2b9-4779-8908-e77efc21f977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff75c4f-002d-448b-b666-c65c24b61378', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7735dd-ac5e-47e0-a0a8-d54a11b0f696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:59 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Volume volume-aff75c4f-002d-448b-b666-c65c24b61378 (aff75c4f-002d-448b-b666-c65c24b61378): created successfully Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab7735dd-ac5e-47e0-a0a8-d54a11b0f696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (45884ea1-a5d1-4e9f-a463-2892500e828f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:59 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-62caa88e-dbe5-4341-b855-5ec5c8f664e4 tempest-VolumesActionsTest-813773968 None] Created volume successfully. Apr 22 09:26:59 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Delete snapshot completed successfully. Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5b6d8e72-1e31-4a6b-ac99-6f78bd61aa65 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-5cc69977-f4df-4494-8d02-1d41d7d6b4e3-delete_snapshot" released by "delete_snapshot" :: held 2.439s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Flow 'volume_create_manager' (947f1e23-39f7-4111-88bf-3a9056f32a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a87f42f-ebc3-4bd0-ad1e-91a37fbb53d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a87f42f-ebc3-4bd0-ad1e-91a37fbb53d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1341995961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec64415d-b7b9-404f-a5b5-4e59ae95b9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1adac5e5087a4236b7f0139f21a53a86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39a96276-d455-4fb8-a75f-796d7b1da436,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:00Z,use_quota=True,user_id='155cd5bc9aa34223b6249d979d50e14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead09093-3075-4c58-8e3d-942449564ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ead09093-3075-4c58-8e3d-942449564ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cad083d-68a3-4116-9962-e665c570a189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cad083d-68a3-4116-9962-e665c570a189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ec64415d-b7b9-404f-a5b5-4e59ae95b9a7', 'volume_name': 'volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7', 'volume_size': 1, 'snapshot_id': '39a96276-d455-4fb8-a75f-796d7b1da436'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73ce802-c50e-404b-8516-45b162df44e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e73ce802-c50e-404b-8516-45b162df44e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a728ad-a49e-4073-bbc9-67c16291c24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:59 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Volume ec64415d-b7b9-404f-a5b5-4e59ae95b9a7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7', 'volume_size': 1, 'snapshot_id': '39a96276-d455-4fb8-a75f-796d7b1da436'} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-quobyte-39a96276-d455-4fb8-a75f-796d7b1da436-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" by "_create_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-39a96276-d455-4fb8-a75f-796d7b1da436-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Creating volume ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 from snapshot 39a96276-d455-4fb8-a75f-796d7b1da436 {{(pid=82642) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-quobyte-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Flow 'volume_create_manager' (ccb98162-a93f-4853-95c0-af44f0bd5fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b0a87c-199d-40a0-9672-8efcdb06bebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36b0a87c-199d-40a0-9672-8efcdb06bebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1766849631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e56a34-6199-4dfa-bb1f-5028db0687a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dda24e07ba1a4004a522e1120da66d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:00Z,use_quota=True,user_id='adcbf47e1aa245d4b2e21874549f915b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a12cf8f-3f5d-4596-8e46-4121cf746257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a12cf8f-3f5d-4596-8e46-4121cf746257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2edf348-cc9d-406a-8605-f765e92f6779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2edf348-cc9d-406a-8605-f765e92f6779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03e56a34-6199-4dfa-bb1f-5028db0687a3', 'volume_name': 'volume-03e56a34-6199-4dfa-bb1f-5028db0687a3', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c6c80d-0622-48b0-864d-6d071a6c87cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c6c80d-0622-48b0-864d-6d071a6c87cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bd2024-de63-4199-ae6a-2661f294795b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:26:59 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Volume 03e56a34-6199-4dfa-bb1f-5028db0687a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03e56a34-6199-4dfa-bb1f-5028db0687a3', 'volume_size': 1} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" acquired by "_copy_volume_from_snapshot" :: waited 0.065s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] snapshot: 39a96276-d455-4fb8-a75f-796d7b1da436, volume: ec64415d-b7b9-404f-a5b5-4e59ae95b9a7, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[47535894-d8d7-4036-b784-61272347f1e2]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:26:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:26:59 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 Apr 22 09:26:59 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:00 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436" returned: 0 in 0.482s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42e3e94e-5c26-493d-ac70-55e24f220d3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[598462bd-9704-448a-8778-59c1dee86515]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "cinder-2aab66c2-2052-411a-8990-4d076788b207-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-2aab66c2-2052-411a-8990-4d076788b207-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "cinder-quobyte-2aab66c2-2052-411a-8990-4d076788b207" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-2aab66c2-2052-411a-8990-4d076788b207" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Deleting offline snapshot 2aab66c2-2052-411a-8990-4d076788b207 of volume 72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] snapshot_file for this snap is: volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbc7c95-6995-473b-b2e4-3e7603cd15b7]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:00 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e Apr 22 09:27:00 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:00 devstack sudo[89236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 Apr 22 09:27:00 devstack sudo[89236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Acquiring lock "cinder-aff75c4f-002d-448b-b666-c65c24b61378-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-aff75c4f-002d-448b-b666-c65c24b61378-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Acquiring lock "cinder-quobyte-aff75c4f-002d-448b-b666-c65c24b61378" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-quobyte-aff75c4f-002d-448b-b666-c65c24b61378" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bbf058-5d03-426e-99b9-82017f1dd4e3]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:00 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e" returned: 0 in 0.541s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:00 devstack sudo[89246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 Apr 22 09:27:00 devstack sudo[89246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:00 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378 Apr 22 09:27:00 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:00 devstack sudo[89236]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207" returned: 0 in 0.535s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ac824b-2837-4038-8343-48754b83ead4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f41176-f4c6-4f2e-b505-0ddf10af60d6]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:01 devstack sudo[89249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 Apr 22 09:27:01 devstack sudo[89249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:01 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378" returned: 0 in 0.740s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:01 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378 Apr 22 09:27:01 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:02 devstack sudo[89249]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5" returned: 0 in 1.121s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ac824b-2837-4038-8343-48754b83ead4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:02 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 Apr 22 09:27:02 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:02 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-aff75c4f-002d-448b-b666-c65c24b61378" returned: 0 in 0.884s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-quobyte-aff75c4f-002d-448b-b666-c65c24b61378" released by "delete_volume" :: held 1.663s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Created reservations ['9a232d10-da61-44da-961c-58e573bf745c', '963d595d-fe39-4d53-aa10-894263b8beab', '61223780-c85c-48f9-9628-d8f5a7e3d00d', '0c3cec5c-0f40-4a0f-b5a3-8b9015ca5845'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:02 devstack sudo[89276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:02 devstack sudo[89276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:02 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207" returned: 0 in 0.884s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:03 devstack sudo[89279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207 Apr 22 09:27:03 devstack sudo[89279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:03 devstack sudo[89246]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" returned: 0 in 2.242s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4475fb36-24c7-44d9-afa7-21db4dcd47a0]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:03 devstack sudo[89281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e Apr 22 09:27:03 devstack sudo[89281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:03 devstack sudo[89276]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.660s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:03 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Deleted volume successfully. Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7edb4749-9886-490b-8981-37f39423f8a8 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-aff75c4f-002d-448b-b666-c65c24b61378-delete_volume" released by "delete_volume" :: held 2.600s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (69d7674c-c8e1-4a60-84b9-e3fdbbea2c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4997ad-aced-4559-accd-7a3b2502e7b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4997ad-aced-4559-accd-7a3b2502e7b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1028798334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4949403-d137-4394-a8e6-72bbcf4901f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:03Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f60702-805f-42c0-b1ab-b39a40918fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f60702-805f-42c0-b1ab-b39a40918fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8218a2-9940-41e1-8c96-e34be5f6efb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b8218a2-9940-41e1-8c96-e34be5f6efb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4949403-d137-4394-a8e6-72bbcf4901f8', 'volume_name': 'volume-c4949403-d137-4394-a8e6-72bbcf4901f8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f284ad42-c053-4836-9e5f-ed10be18dee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f284ad42-c053-4836-9e5f-ed10be18dee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:03 devstack sudo[89279]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e02c8a2-5448-4b9f-a3f0-481fb51277df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:03 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Volume c4949403-d137-4394-a8e6-72bbcf4901f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4949403-d137-4394-a8e6-72bbcf4901f8', 'volume_size': 1} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.2aab66c2-2052-411a-8990-4d076788b207" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-2aab66c2-2052-411a-8990-4d076788b207" released by "_delete_snapshot" :: held 3.102s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" released by "delete_snapshot" :: held 3.115s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Created reservations ['bd70ef39-6183-4b9b-989c-b472338afdbe', '3c58bb72-7db2-4a76-bf90-6d74e690066c', '91f0bb60-adc5-4379-be1a-6843b3e21002', 'abd389c3-2d8d-47c3-bf85-51a44da42b0a'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:03 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Delete snapshot completed successfully. Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-31e31b21-42d1-4bff-97e1-2bcb705448f8 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-2aab66c2-2052-411a-8990-4d076788b207-delete_snapshot" released by "delete_snapshot" :: held 3.195s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:03 devstack sudo[89281]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e" returned: 0 in 0.663s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e, size 1024.00 MB, duration 2.24 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:27:03 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Converted 1024.00 MB image at 456.39 MB/s Apr 22 09:27:03 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 is being set with open permissions: ugo+rw Apr 22 09:27:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:03 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 Apr 22 09:27:03 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:04 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" returned: 0 in 0.404s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" released by "_copy_volume_from_snapshot" :: held 4.387s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-39a96276-d455-4fb8-a75f-796d7b1da436-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" released by "_create_volume_from_snapshot" :: held 4.463s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.480s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.400s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1766849631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03e56a34-6199-4dfa-bb1f-5028db0687a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dda24e07ba1a4004a522e1120da66d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:00Z,use_quota=True,user_id='adcbf47e1aa245d4b2e21874549f915b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Creating volume 03e56a34-6199-4dfa-bb1f-5028db0687a3 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:04 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:04 devstack sudo[89291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3 1073741824 Apr 22 09:27:04 devstack sudo[89291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84a728ad-a49e-4073-bbc9-67c16291c24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7', 'volume_size': 1, 'snapshot_id': '39a96276-d455-4fb8-a75f-796d7b1da436'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e461c3-ae1d-4558-b91f-f0253d1b3579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:04 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Volume volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 (ec64415d-b7b9-404f-a5b5-4e59ae95b9a7): created successfully Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e461c3-ae1d-4558-b91f-f0253d1b3579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Flow 'volume_create_manager' (947f1e23-39f7-4111-88bf-3a9056f32a1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:04 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-aeca4dd9-145e-4be7-9d0d-09f5fc8a190b tempest-VolumesDeleteCascade-1823056562 None] Created volume successfully. Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "cinder-cecf94e9-7ed3-433c-8b2d-8b96e11211b5-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-cecf94e9-7ed3-433c-8b2d-8b96e11211b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "cinder-quobyte-cecf94e9-7ed3-433c-8b2d-8b96e11211b5" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-cecf94e9-7ed3-433c-8b2d-8b96e11211b5" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Deleting offline snapshot cecf94e9-7ed3-433c-8b2d-8b96e11211b5 of volume 72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] snapshot_file for this snap is: volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3464bd1-9ccf-4280-8e24-1874f20da7b9]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:04 devstack sudo[89296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 Apr 22 09:27:04 devstack sudo[89296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:04 devstack sudo[89291]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3 1073741824" returned: 0 in 0.498s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:04 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3 Apr 22 09:27:04 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:05 devstack sudo[89296]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5" returned: 0 in 0.539s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ac824b-2837-4038-8343-48754b83ead4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[16293293-00d7-435f-a459-20c0f1a3d0a2]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:05 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3" returned: 0 in 0.440s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1028798334',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4949403-d137-4394-a8e6-72bbcf4901f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:03Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Creating volume c4949403-d137-4394-a8e6-72bbcf4901f8 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:05 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-42e3e94e-5c26-493d-ac70-55e24f220d3e-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:05 devstack sudo[89305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8 1073741824 Apr 22 09:27:05 devstack sudo[89305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5bd2024-de63-4199-ae6a-2661f294795b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03e56a34-6199-4dfa-bb1f-5028db0687a3', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20d8727-1dc4-44d7-8549-d7ba613b8afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-42e3e94e-5c26-493d-ac70-55e24f220d3e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:05 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Volume volume-03e56a34-6199-4dfa-bb1f-5028db0687a3 (03e56a34-6199-4dfa-bb1f-5028db0687a3): created successfully Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e20d8727-1dc4-44d7-8549-d7ba613b8afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:05 devstack sudo[89304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 Apr 22 09:27:05 devstack sudo[89304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Flow 'volume_create_manager' (ccb98162-a93f-4853-95c0-af44f0bd5fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:05 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-bddf0014-ecff-4eb3-ba62-681f16bf9db1 tempest-VolumesListTestJSON-1139438337 None] Created volume successfully. Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Performing cascade delete. {{(pid=82642) delete_volume /opt/stack/cinder/cinder/volume/manager.py:998}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-39a96276-d455-4fb8-a75f-796d7b1da436-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-39a96276-d455-4fb8-a75f-796d7b1da436-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-quobyte-42e3e94e-5c26-493d-ac70-55e24f220d3e" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-42e3e94e-5c26-493d-ac70-55e24f220d3e" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-quobyte-39a96276-d455-4fb8-a75f-796d7b1da436" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-39a96276-d455-4fb8-a75f-796d7b1da436" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Deleting offline snapshot 39a96276-d455-4fb8-a75f-796d7b1da436 of volume 42e3e94e-5c26-493d-ac70-55e24f220d3e {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] snapshot_file for this snap is: volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4487c579-d923-4376-ab6b-21150fe1b656]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:05 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 Apr 22 09:27:05 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:05 devstack sudo[89304]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4" returned: 0 in 0.517s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:05 devstack sudo[89316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 Apr 22 09:27:05 devstack sudo[89316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:05 devstack sudo[89305]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8 1073741824" returned: 0 in 0.525s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:05 devstack sudo[89321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8 Apr 22 09:27:05 devstack sudo[89321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:05 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436" returned: 0 in 0.486s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42e3e94e-5c26-493d-ac70-55e24f220d3e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4196e0-ecbb-4d87-a625-9b541496ef67]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:05 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e Apr 22 09:27:05 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:06 devstack sudo[89316]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5" returned: 0 in 0.471s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:06 devstack sudo[89329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5 Apr 22 09:27:06 devstack sudo[89329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:06 devstack sudo[89321]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8" returned: 0 in 0.458s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e02c8a2-5448-4b9f-a3f0-481fb51277df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4949403-d137-4394-a8e6-72bbcf4901f8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c4b0ba-c3a6-4fc9-ba7a-c86e289f178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:06 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Volume volume-c4949403-d137-4394-a8e6-72bbcf4901f8 (c4949403-d137-4394-a8e6-72bbcf4901f8): created successfully Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c4b0ba-c3a6-4fc9-ba7a-c86e289f178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (69d7674c-c8e1-4a60-84b9-e3fdbbea2c05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:06 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-8955c465-41b6-4393-949d-bab06e05892c tempest-VolumesActionsTest-813773968 None] Created volume successfully. Apr 22 09:27:06 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:06 devstack sudo[89334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 Apr 22 09:27:06 devstack sudo[89334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Flow 'volume_create_manager' (3b172aae-6ca0-453a-bc0d-5dc1a73ebecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f8face-4f0b-43fc-8f7d-5102f85bd16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0f8face-4f0b-43fc-8f7d-5102f85bd16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-251016567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6690c68a-55cb-4bee-a9d1-b768b7419c19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dda24e07ba1a4004a522e1120da66d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:07Z,use_quota=True,user_id='adcbf47e1aa245d4b2e21874549f915b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e27595-c084-40fb-9d2e-d3e33dc2177a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66e27595-c084-40fb-9d2e-d3e33dc2177a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ea5f02-7e83-4131-87a5-f808719423ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ea5f02-7e83-4131-87a5-f808719423ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6690c68a-55cb-4bee-a9d1-b768b7419c19', 'volume_name': 'volume-6690c68a-55cb-4bee-a9d1-b768b7419c19', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45aabc7-08cd-4665-89ec-5373af69e1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45aabc7-08cd-4665-89ec-5373af69e1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76634d70-8218-4b1f-93f1-d055163eb16f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:06 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Volume 6690c68a-55cb-4bee-a9d1-b768b7419c19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6690c68a-55cb-4bee-a9d1-b768b7419c19', 'volume_size': 1} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-251016567',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6690c68a-55cb-4bee-a9d1-b768b7419c19,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dda24e07ba1a4004a522e1120da66d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:07Z,use_quota=True,user_id='adcbf47e1aa245d4b2e21874549f915b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Creating volume 6690c68a-55cb-4bee-a9d1-b768b7419c19 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:06 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:06 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19 1073741824 Apr 22 09:27:06 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:06 devstack sudo[89329]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4.cecf94e9-7ed3-433c-8b2d-8b96e11211b5" returned: 0 in 0.513s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Acquiring lock "cinder-c4949403-d137-4394-a8e6-72bbcf4901f8-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-cecf94e9-7ed3-433c-8b2d-8b96e11211b5" released by "_delete_snapshot" :: held 2.111s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-c4949403-d137-4394-a8e6-72bbcf4901f8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" released by "delete_snapshot" :: held 2.134s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Acquiring lock "cinder-quobyte-c4949403-d137-4394-a8e6-72bbcf4901f8" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-quobyte-c4949403-d137-4394-a8e6-72bbcf4901f8" acquired by "delete_volume" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11fdf01-f2d9-4ff1-99ce-732bcbb98079]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Created reservations ['2aa795d1-3b88-49f4-9045-d9941f74710d', '14b433c7-ec6c-45bb-af34-103c317795d8', '51203286-421a-45a0-8cf4-ae66505f61c7', 'd9e07c99-e15b-4977-8e9b-f976eba99778'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:06 devstack sudo[89334]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436" returned: 0 in 0.512s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:06 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Delete snapshot completed successfully. Apr 22 09:27:06 devstack sudo[89342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8 Apr 22 09:27:06 devstack sudo[89342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bde84f5c-7b07-4261-aa13-7efe4eb4d878 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-cecf94e9-7ed3-433c-8b2d-8b96e11211b5-delete_snapshot" released by "delete_snapshot" :: held 2.303s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:06 devstack sudo[89343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436 Apr 22 09:27:06 devstack sudo[89343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:07 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19 1073741824" returned: 0 in 0.565s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:07 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19 Apr 22 09:27:07 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:07 devstack sudo[89342]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8" returned: 0 in 0.479s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:07 devstack sudo[89355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8 Apr 22 09:27:07 devstack sudo[89355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:07 devstack sudo[89343]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e.39a96276-d455-4fb8-a75f-796d7b1da436" returned: 0 in 0.458s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-39a96276-d455-4fb8-a75f-796d7b1da436" released by "_delete_snapshot" :: held 2.014s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-42e3e94e-5c26-493d-ac70-55e24f220d3e" released by "delete_snapshot" :: held 2.026s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Created reservations ['525b769b-a8a2-4aec-a48a-c374c5df17bc', 'f78f8fe4-931b-4abb-b182-f89f0f06eb5f', '403fd987-3caf-42f2-acc0-a74763e2b684', 'b33203ba-e837-432f-a93d-e94dbda062fb'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:07 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Delete snapshot completed successfully. Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-39a96276-d455-4fb8-a75f-796d7b1da436-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Snapshots deleted, issuing volume delete {{(pid=82642) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1013}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-quobyte-42e3e94e-5c26-493d-ac70-55e24f220d3e" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-42e3e94e-5c26-493d-ac70-55e24f220d3e" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e863281-5048-42d7-846d-add02a98772f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:07 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e Apr 22 09:27:07 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:07 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19" returned: 0 in 0.432s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76634d70-8218-4b1f-93f1-d055163eb16f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6690c68a-55cb-4bee-a9d1-b768b7419c19', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d11730-3334-45fc-8d41-2b124a13bd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:07 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Volume volume-6690c68a-55cb-4bee-a9d1-b768b7419c19 (6690c68a-55cb-4bee-a9d1-b768b7419c19): created successfully Apr 22 09:27:07 devstack sudo[89355]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d11730-3334-45fc-8d41-2b124a13bd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Flow 'volume_create_manager' (3b172aae-6ca0-453a-bc0d-5dc1a73ebecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c4949403-d137-4394-a8e6-72bbcf4901f8" returned: 0 in 0.440s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:07 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d97d9494-6b31-483d-a931-2f9695362f54 tempest-VolumesListTestJSON-1139438337 None] Created volume successfully. Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-quobyte-c4949403-d137-4394-a8e6-72bbcf4901f8" released by "delete_volume" :: held 0.967s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Created reservations ['cf8dfaf3-cb9f-4e5c-a47b-40a14298c9b6', 'b67b0d56-54e9-411c-935e-4bf0d34a8c47', '9e9b6db2-a7ac-4d4d-8301-0e013734ffd4', '94fd949e-552a-448e-b684-4e120d6c57dc'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "cinder-72ac824b-2837-4038-8343-48754b83ead4-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-72ac824b-2837-4038-8343-48754b83ead4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c4e783-04f0-4996-9e17-1aef72c07d14]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:07 devstack sudo[89365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:07 devstack sudo[89365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:07 devstack sudo[89364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 Apr 22 09:27:07 devstack sudo[89364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:07 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e" returned: 0 in 0.515s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:07 devstack sudo[89368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e Apr 22 09:27:07 devstack sudo[89368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:08 devstack sudo[89365]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.407s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:08 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Deleted volume successfully. Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb293bb1-18bd-4e52-a004-bf5da2a13db0 tempest-VolumesActionsTest-1438487981 None] Lock "cinder-c4949403-d137-4394-a8e6-72bbcf4901f8-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:08 devstack sudo[89364]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4" returned: 0 in 0.466s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:08 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4 Apr 22 09:27:08 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:08 devstack sudo[89368]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-42e3e94e-5c26-493d-ac70-55e24f220d3e" returned: 0 in 0.439s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-42e3e94e-5c26-493d-ac70-55e24f220d3e" released by "delete_volume" :: held 0.982s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Created reservations ['1ee42d08-bc46-43d9-ae7b-dcdf9c217478', '41e31f77-1b9d-48f4-b2d7-d4642cf08512', '20c0c7ba-39e9-42ce-8d2b-f582e369c6b3', '11c2852e-7885-454f-a199-c75569c532c7'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:08 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:08 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:08 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-72ac824b-2837-4038-8343-48754b83ead4" returned: 0 in 0.469s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-quobyte-72ac824b-2837-4038-8343-48754b83ead4" released by "delete_volume" :: held 0.971s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Created reservations ['627a7505-2d1c-485a-86dd-548975cdfc85', 'be9200d5-4729-4d4c-b122-3c9490a9eba4', '741a6d59-98c0-4afb-a0f9-f2b9896c8d1b', '7f01cc42-a3fa-4d38-b959-9b055a465eb8'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:08 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.434s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:08 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Deleted volume successfully. Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ba911f1f-5253-47d9-84f4-4a6c3ac508a4 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-42e3e94e-5c26-493d-ac70-55e24f220d3e-delete_volume" released by "delete_volume" :: held 3.727s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:08 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:09 devstack sudo[89381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:09 devstack sudo[89381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Flow 'volume_create_manager' (d1b28821-a854-4493-b0d2-70fcb72fd990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88da14c7-be30-421d-ad8a-b3e41f54c114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88da14c7-be30-421d-ad8a-b3e41f54c114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1763700745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9734e4de-4b26-438b-9e25-5e913f50a29a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dda24e07ba1a4004a522e1120da66d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:09Z,use_quota=True,user_id='adcbf47e1aa245d4b2e21874549f915b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e9fb23-a4c9-4ac7-964d-c84c6431f10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1e9fb23-a4c9-4ac7-964d-c84c6431f10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4417497c-bbab-4145-b727-aa3ec9bf9c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4417497c-bbab-4145-b727-aa3ec9bf9c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9734e4de-4b26-438b-9e25-5e913f50a29a', 'volume_name': 'volume-9734e4de-4b26-438b-9e25-5e913f50a29a', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0eaba46-ef96-4cf7-a77e-87f92120f0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0eaba46-ef96-4cf7-a77e-87f92120f0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1966e6a3-a459-4271-bc72-2ac170c4357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:09 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Volume 9734e4de-4b26-438b-9e25-5e913f50a29a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9734e4de-4b26-438b-9e25-5e913f50a29a', 'volume_size': 1} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1763700745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9734e4de-4b26-438b-9e25-5e913f50a29a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dda24e07ba1a4004a522e1120da66d60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:09Z,use_quota=True,user_id='adcbf47e1aa245d4b2e21874549f915b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Creating volume 9734e4de-4b26-438b-9e25-5e913f50a29a {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:09 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:09 devstack sudo[89383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a 1073741824 Apr 22 09:27:09 devstack sudo[89383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (81d885fd-fff1-4c36-943c-866d85a64841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e4b807-3e87-476c-a019-6851183cbde6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4e4b807-3e87-476c-a019-6851183cbde6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-949792456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc24bde-e771-45e4-bc8b-ed7222825114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:09Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3729526d-4bc6-4db4-8411-61bff13b087d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3729526d-4bc6-4db4-8411-61bff13b087d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a89057e-0a5d-486e-a224-51737df2a604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a89057e-0a5d-486e-a224-51737df2a604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc24bde-e771-45e4-bc8b-ed7222825114', 'volume_name': 'volume-0cc24bde-e771-45e4-bc8b-ed7222825114', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d97790-a102-4773-8398-a6832a4b93c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48d97790-a102-4773-8398-a6832a4b93c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af563d45-eea7-4b12-bf7a-80b67415a871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:09 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Volume 0cc24bde-e771-45e4-bc8b-ed7222825114: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc24bde-e771-45e4-bc8b-ed7222825114', 'volume_size': 1} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:09 devstack sudo[89381]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.425s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:09 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Deleted volume successfully. Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ef1f7196-a57b-4940-ba1a-81aefc880513 tempest-VolumesSnapshotListTestJSON-826383756 None] Lock "cinder-72ac824b-2837-4038-8343-48754b83ead4-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:09 devstack sudo[89383]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a 1073741824" returned: 0 in 0.530s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:09 devstack sudo[89389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a Apr 22 09:27:09 devstack sudo[89389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "cinder-quobyte-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[240b3136-7b43-4593-9cd2-1229d286fe06]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:09 devstack sudo[89391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 Apr 22 09:27:09 devstack sudo[89391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:10 devstack sudo[89389]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a" returned: 0 in 0.430s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.816s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-949792456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc24bde-e771-45e4-bc8b-ed7222825114,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:09Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Creating volume 0cc24bde-e771-45e4-bc8b-ed7222825114 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:10 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1966e6a3-a459-4271-bc72-2ac170c4357f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9734e4de-4b26-438b-9e25-5e913f50a29a', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:10 devstack sudo[89396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114 1073741824 Apr 22 09:27:10 devstack sudo[89396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8448781c-424c-4d4a-9e94-8385f9fab63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:10 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Volume volume-9734e4de-4b26-438b-9e25-5e913f50a29a (9734e4de-4b26-438b-9e25-5e913f50a29a): created successfully Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8448781c-424c-4d4a-9e94-8385f9fab63d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Flow 'volume_create_manager' (d1b28821-a854-4493-b0d2-70fcb72fd990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:10 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7ad6f3ab-72ed-4a45-bc04-4a3ee74a4ef2 tempest-VolumesListTestJSON-1139438337 None] Created volume successfully. Apr 22 09:27:10 devstack sudo[89391]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:10 devstack sudo[89399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7 Apr 22 09:27:10 devstack sudo[89399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:10 devstack sudo[89396]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114 1073741824" returned: 0 in 0.557s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:10 devstack sudo[89405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114 Apr 22 09:27:10 devstack sudo[89405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:10 devstack sudo[89399]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" returned: 0 in 0.516s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-quobyte-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7" released by "delete_volume" :: held 1.070s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Created reservations ['1ebc0014-531f-4136-beec-a4dc49edf770', '0c547c20-88e4-4022-bc02-fd9d8c168c7f', '940e91dd-3af5-4166-be7f-7b9a0e15353e', '9e2fe4af-5b9a-4b74-b544-72691cbf4967'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:10 devstack sudo[89407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:10 devstack sudo[89407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:11 devstack sudo[89405]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114" returned: 0 in 0.500s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af563d45-eea7-4b12-bf7a-80b67415a871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc24bde-e771-45e4-bc8b-ed7222825114', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3fc6f9-189f-4351-978a-09c93e468a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:11 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Volume volume-0cc24bde-e771-45e4-bc8b-ed7222825114 (0cc24bde-e771-45e4-bc8b-ed7222825114): created successfully Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df3fc6f9-189f-4351-978a-09c93e468a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (81d885fd-fff1-4c36-943c-866d85a64841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:11 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-cb8626d1-9c60-4811-af08-88220032747e tempest-VolumesActionsTest-813773968 None] Created volume successfully. Apr 22 09:27:11 devstack sudo[89407]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.599s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:11 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Deleted volume successfully. Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-93a2c8e3-7994-4acb-84c8-6eca392f1349 tempest-VolumesDeleteCascade-1823056562 None] Lock "cinder-ec64415d-b7b9-404f-a5b5-4e59ae95b9a7-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Acquiring lock "cinder-0cc24bde-e771-45e4-bc8b-ed7222825114-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Lock "cinder-0cc24bde-e771-45e4-bc8b-ed7222825114-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Acquiring lock "cinder-quobyte-0cc24bde-e771-45e4-bc8b-ed7222825114" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Lock "cinder-quobyte-0cc24bde-e771-45e4-bc8b-ed7222825114" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4608dd19-0b78-49b1-800e-bc915f3fdc1a]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:11 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114 Apr 22 09:27:11 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (8794a813-0336-457f-9e43-46175c3ce015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70ec1ef-5618-4afd-ad36-e6c94d881e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b70ec1ef-5618-4afd-ad36-e6c94d881e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-205596624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9605f3e7-eb92-44d2-8229-8d8a557b9232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:12Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783eb686-3f3f-4073-b7fc-e7197291cb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (783eb686-3f3f-4073-b7fc-e7197291cb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb46880c-e950-4e9c-8097-47ddbd8bca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb46880c-e950-4e9c-8097-47ddbd8bca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9605f3e7-eb92-44d2-8229-8d8a557b9232', 'volume_name': 'volume-9605f3e7-eb92-44d2-8229-8d8a557b9232', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33277e6f-3489-46bc-8085-f1478760a4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33277e6f-3489-46bc-8085-f1478760a4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd6bd34-1550-40ee-b2d4-da4b7e609719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:12 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume 9605f3e7-eb92-44d2-8229-8d8a557b9232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9605f3e7-eb92-44d2-8229-8d8a557b9232', 'volume_size': 1} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-205596624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9605f3e7-eb92-44d2-8229-8d8a557b9232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:12Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Creating volume 9605f3e7-eb92-44d2-8229-8d8a557b9232 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:12 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:12 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 1073741824 Apr 22 09:27:12 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:12 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114" returned: 0 in 0.609s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:12 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114 Apr 22 09:27:12 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:12 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0cc24bde-e771-45e4-bc8b-ed7222825114" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Lock "cinder-quobyte-0cc24bde-e771-45e4-bc8b-ed7222825114" released by "delete_volume" :: held 1.160s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:12 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 1073741824" returned: 0 in 0.620s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Created reservations ['aed8a059-a73c-45e6-a4a3-8c53d4a00ee6', 'd300f7df-eaeb-46fb-9796-d5a0f37f5ff9', '7d826aed-fa01-46b6-8a90-1f2211599fac', '7a99bfdf-49b4-4183-a710-5de857a8942d'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:12 devstack sudo[89427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 Apr 22 09:27:12 devstack sudo[89427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:12 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:12 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "cinder-9734e4de-4b26-438b-9e25-5e913f50a29a-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-9734e4de-4b26-438b-9e25-5e913f50a29a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "cinder-quobyte-9734e4de-4b26-438b-9e25-5e913f50a29a" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-quobyte-9734e4de-4b26-438b-9e25-5e913f50a29a" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d32562-db5d-482e-919a-62e8de65d9e7]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:13 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a Apr 22 09:27:13 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:13 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.526s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:13 devstack sudo[89427]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:13 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Deleted volume successfully. Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232" returned: 0 in 0.632s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd6bd34-1550-40ee-b2d4-da4b7e609719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9605f3e7-eb92-44d2-8229-8d8a557b9232', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee998456-270e-42c3-b1a6-afd585d7438f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-db32414b-20ab-42e5-b790-20630abe680f tempest-VolumesActionsTest-1438487981 None] Lock "cinder-0cc24bde-e771-45e4-bc8b-ed7222825114-delete_volume" released by "delete_volume" :: held 1.900s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:13 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 (9605f3e7-eb92-44d2-8229-8d8a557b9232): created successfully Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee998456-270e-42c3-b1a6-afd585d7438f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (8794a813-0336-457f-9e43-46175c3ce015) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:13 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-1238389d-88aa-4877-b0bc-a1bc6f623444 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created volume successfully. Apr 22 09:27:13 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a" returned: 0 in 0.593s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:13 devstack sudo[89438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a Apr 22 09:27:13 devstack sudo[89438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Flow 'volume_create_manager' (ba8cce2a-157e-4f6b-b8d8-9dea4dbf7868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4b3206-2c4f-48b6-bfe6-15b8652e007a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc4b3206-2c4f-48b6-bfe6-15b8652e007a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-15035108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e68794-5adb-4203-997f-d8a310eb2483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f8e91af28c4426a95ebd762074431a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:14Z,use_quota=True,user_id='3e1c6bfd7fac4b1bb802228510558027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0ab9ec-233f-4f79-9c93-21a1fc68e9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0ab9ec-233f-4f79-9c93-21a1fc68e9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec22c42-5f26-42d9-9aa3-f68951551aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec22c42-5f26-42d9-9aa3-f68951551aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e68794-5adb-4203-997f-d8a310eb2483', 'volume_name': 'volume-52e68794-5adb-4203-997f-d8a310eb2483', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84c1ec7-0efa-4610-97d7-41d0876acde5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b84c1ec7-0efa-4610-97d7-41d0876acde5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11dedc80-7493-412d-bddd-de208e30198e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:13 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Volume 52e68794-5adb-4203-997f-d8a310eb2483: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e68794-5adb-4203-997f-d8a310eb2483', 'volume_size': 1} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-15035108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e68794-5adb-4203-997f-d8a310eb2483,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f8e91af28c4426a95ebd762074431a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:14Z,use_quota=True,user_id='3e1c6bfd7fac4b1bb802228510558027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Creating volume 52e68794-5adb-4203-997f-d8a310eb2483 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:13 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:13 devstack sudo[89440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 1073741824 Apr 22 09:27:13 devstack sudo[89440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:13 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (bb885cb4-224f-4145-8125-e714497307a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4627a204-946f-4c43-9322-6fac8f0444de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4627a204-946f-4c43-9322-6fac8f0444de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-633795465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569fa5e2-19bb-4524-a39a-7dd8f061bf52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:14Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9834e8-4cab-44d0-bdda-4f771c2d2875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9834e8-4cab-44d0-bdda-4f771c2d2875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c53c5fa-024d-4190-a990-6edc8ba50f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c53c5fa-024d-4190-a990-6edc8ba50f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '569fa5e2-19bb-4524-a39a-7dd8f061bf52', 'volume_name': 'volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef34d74e-58bd-482b-afdf-a45c67e87d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef34d74e-58bd-482b-afdf-a45c67e87d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ac6cba-f3fd-4ff8-ae52-d25bdb1f625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:14 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Volume 569fa5e2-19bb-4524-a39a-7dd8f061bf52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52', 'volume_size': 1} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:14 devstack sudo[89438]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9734e4de-4b26-438b-9e25-5e913f50a29a" returned: 0 in 0.549s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-quobyte-9734e4de-4b26-438b-9e25-5e913f50a29a" released by "delete_volume" :: held 1.184s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Created reservations ['ec53fb32-6c11-41dd-bbfb-b482c25a752a', '0891b8c9-4e91-41f0-bc2a-cdae737b4d36', '6b2f4b85-96bc-4618-b2a2-260650bed4dc', '02972f47-fa95-4f92-9abc-ef546f626256'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:14 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:14 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:14 devstack sudo[89440]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 1073741824" returned: 0 in 0.506s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:14 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 Apr 22 09:27:14 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.435s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:14 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Deleted volume successfully. Apr 22 09:27:14 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-23ea074f-bb8b-465d-abec-aea0ec069507 tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-9734e4de-4b26-438b-9e25-5e913f50a29a-delete_volume" released by "delete_volume" :: held 1.770s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:14 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483" returned: 0 in 0.417s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.854s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-633795465',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=569fa5e2-19bb-4524-a39a-7dd8f061bf52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='896a10cd13454bb98e785d1657f9b770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:14Z,use_quota=True,user_id='3d1ff621d05b435089a928e425ef68e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Creating volume 569fa5e2-19bb-4524-a39a-7dd8f061bf52 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:14 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11dedc80-7493-412d-bddd-de208e30198e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e68794-5adb-4203-997f-d8a310eb2483', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff79231-1286-4889-8648-2de2f581f7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:14 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52 1073741824 Apr 22 09:27:14 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:14 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Volume volume-52e68794-5adb-4203-997f-d8a310eb2483 (52e68794-5adb-4203-997f-d8a310eb2483): created successfully Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff79231-1286-4889-8648-2de2f581f7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Flow 'volume_create_manager' (ba8cce2a-157e-4f6b-b8d8-9dea4dbf7868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:14 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-a2cb688b-1820-442b-a4ed-95f99f254e2f tempest-VolumesCloneTest-1536448227 None] Created volume successfully. Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "cinder-6690c68a-55cb-4bee-a9d1-b768b7419c19-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-6690c68a-55cb-4bee-a9d1-b768b7419c19-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "cinder-quobyte-6690c68a-55cb-4bee-a9d1-b768b7419c19" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-quobyte-6690c68a-55cb-4bee-a9d1-b768b7419c19" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[819b8958-95aa-4888-9b09-a87832150553]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:15 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52 1073741824" returned: 0 in 0.554s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:15 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52 Apr 22 09:27:15 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:15 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19 Apr 22 09:27:15 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:15 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52" returned: 0 in 0.414s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.691s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Creating offline snapshot ed093095-5693-44c1-b917-fa77d0d8e2eb of volume 9605f3e7-eb92-44d2-8229-8d8a557b9232 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7ac6cba-f3fd-4ff8-ae52-d25bdb1f625f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40eef36-d842-48cf-b053-b18458ba316a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa62a05-ce61-4ffa-8094-cdb5ebe10b99]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:15 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:15 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Volume volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52 (569fa5e2-19bb-4524-a39a-7dd8f061bf52): created successfully Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e40eef36-d842-48cf-b053-b18458ba316a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Flow 'volume_create_manager' (bb885cb4-224f-4145-8125-e714497307a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19" returned: 0 in 0.532s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-3b7045c3-54fd-46eb-9e2d-c8d771240f1b tempest-VolumesActionsTest-813773968 None] Created volume successfully. Apr 22 09:27:16 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19 Apr 22 09:27:16 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:16 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 Apr 22 09:27:16 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Flow 'volume_create_manager' (aa86df53-a447-4dda-89ae-9485fec025ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5b18d4-4467-4cc9-9e17-b21066af98c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef5b18d4-4467-4cc9-9e17-b21066af98c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1546553300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a8a3786-c238-4481-8ff4-d48ffb97d4be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1f8e91af28c4426a95ebd762074431a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:16Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=52e68794-5adb-4203-997f-d8a310eb2483,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:16Z,use_quota=True,user_id='3e1c6bfd7fac4b1bb802228510558027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc0ee00-b688-40b9-9c0f-457cebddf7c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fc0ee00-b688-40b9-9c0f-457cebddf7c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01066b4d-86b2-4bea-bd7e-df5b9674bd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01066b4d-86b2-4bea-bd7e-df5b9674bd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '3a8a3786-c238-4481-8ff4-d48ffb97d4be', 'volume_name': 'volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be', 'volume_size': 2, 'source_volid': '52e68794-5adb-4203-997f-d8a310eb2483', 'source_volstatus': 'available'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e858a3-6e0a-44da-803c-6f96dcc4292e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39e858a3-6e0a-44da-803c-6f96dcc4292e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a176fc-f477-4b37-93d8-5c9f03dd3276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:16 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Volume 3a8a3786-c238-4481-8ff4-d48ffb97d4be: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be', 'volume_size': 2, 'source_volid': '52e68794-5adb-4203-997f-d8a310eb2483', 'source_volstatus': 'available'} Apr 22 09:27:16 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6690c68a-55cb-4bee-a9d1-b768b7419c19" returned: 0 in 0.467s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-quobyte-6690c68a-55cb-4bee-a9d1-b768b7419c19" released by "delete_volume" :: held 1.024s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Created reservations ['869b46c0-11c3-459e-954e-cce03531afaa', '7ef6312c-80b0-4b62-840d-4d1aebdc096e', '64a3a331-8d8f-49a9-9f6a-944a6f7b50ce', '1c0062ec-b91a-4e0f-8a55-1ec15407a20d'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:16 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:16 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:16 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232" returned: 0 in 0.613s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Acquiring lock "cinder-569fa5e2-19bb-4524-a39a-7dd8f061bf52-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:16 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb 1G Apr 22 09:27:16 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Lock "cinder-569fa5e2-19bb-4524-a39a-7dd8f061bf52-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Acquiring lock "cinder-quobyte-569fa5e2-19bb-4524-a39a-7dd8f061bf52" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Lock "cinder-quobyte-569fa5e2-19bb-4524-a39a-7dd8f061bf52" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7679649c-8bd9-426b-a345-943292c74987]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:16 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52 Apr 22 09:27:16 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:16 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.430s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Deleted volume successfully. Apr 22 09:27:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-75b91eba-76e3-43ef-a9fb-64bf12f97bd3 tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-6690c68a-55cb-4bee-a9d1-b768b7419c19-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:17 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb 1G" returned: 0 in 0.539s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:17 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb Apr 22 09:27:17 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:17 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52" returned: 0 in 0.496s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:17 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52 Apr 22 09:27:17 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:17 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb" returned: 0 in 0.415s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:17 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb is being set with open permissions: ugo+rw Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:17 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb Apr 22 09:27:17 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:17 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-569fa5e2-19bb-4524-a39a-7dd8f061bf52" returned: 0 in 0.438s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Lock "cinder-quobyte-569fa5e2-19bb-4524-a39a-7dd8f061bf52" released by "delete_volume" :: held 0.956s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Created reservations ['39cfc136-d089-4af7-9f90-317d105605e2', '5b4936b6-cae9-4d8d-9191-9b5ccbf16cac', '6d98113e-7a63-47b5-91e8-1601a7c35dac', '557bb021-765f-414b-8de8-cfc05af4bd2a'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "cinder-03e56a34-6199-4dfa-bb1f-5028db0687a3-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-03e56a34-6199-4dfa-bb1f-5028db0687a3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:17 devstack sudo[89496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:17 devstack sudo[89496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "cinder-quobyte-03e56a34-6199-4dfa-bb1f-5028db0687a3" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-quobyte-03e56a34-6199-4dfa-bb1f-5028db0687a3" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb7647c-15b1-4c9a-9805-a27f7905f357]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:17 devstack sudo[89498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3 Apr 22 09:27:17 devstack sudo[89498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:17 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb" returned: 0 in 0.466s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:18 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.info Apr 22 09:27:18 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:18 devstack sudo[89496]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.409s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:18 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Deleted volume successfully. Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fae0fce0-37ca-4469-b6aa-4d8ccca587e8 tempest-VolumesActionsTest-813773968 None] Lock "cinder-569fa5e2-19bb-4524-a39a-7dd8f061bf52-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:18 devstack sudo[89498]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3" returned: 0 in 0.476s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:18 devstack sudo[89507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3 Apr 22 09:27:18 devstack sudo[89507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:18 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.info" returned: 0 in 0.439s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:18 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.info is being set with open permissions: ugo+rw Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:18 devstack sudo[89510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.info Apr 22 09:27:18 devstack sudo[89510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:18 devstack sudo[89507]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-03e56a34-6199-4dfa-bb1f-5028db0687a3" returned: 0 in 0.436s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-quobyte-03e56a34-6199-4dfa-bb1f-5028db0687a3" released by "delete_volume" :: held 0.934s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Created reservations ['9234f261-0a8a-4b8b-8abd-8ee48e3402ec', '381e7267-8ac6-4fc9-9ce6-3e7bc8c6e931', 'fb3addbd-5526-47d8-a7b5-a05ee4d85025', '411d9125-cd6f-48dc-9c76-eac130c895d8'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:18 devstack sudo[89513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:18 devstack sudo[89513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:18 devstack sudo[89510]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.info" returned: 0 in 0.445s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.994s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.462s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:18 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Cloning volume 52e68794-5adb-4203-997f-d8a310eb2483 to volume 3a8a3786-c238-4481-8ff4-d48ffb97d4be Apr 22 09:27:18 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-91c763ef-9b67-4894-9bf6-b49122f27655 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Create snapshot completed successfully Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Creating offline snapshot cae2fd8e-cde1-48cf-b90c-20c1ded433c8 of volume 52e68794-5adb-4203-997f-d8a310eb2483 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[172bd55a-7c47-4a23-bf80-aa1f91d87cf7]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:19 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 Apr 22 09:27:19 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:19 devstack sudo[89513]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.512s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:19 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Deleted volume successfully. Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-657d0861-6edd-4bf9-ab09-f74d98011cba tempest-VolumesListTestJSON-1139438337 None] Lock "cinder-03e56a34-6199-4dfa-bb1f-5028db0687a3-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:19 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483" returned: 0 in 0.557s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:19 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 1G Apr 22 09:27:19 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (36a1cda1-ff31-4373-b00f-ed2ab033195b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ab3e1b-fe22-4f4d-947d-46a8b76ef323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27ab3e1b-fe22-4f4d-947d-46a8b76ef323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-941880385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728cca08-7685-4217-aca6-b53049585449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:20Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228164e3-84ea-4ffa-b83b-521b9af177fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (228164e3-84ea-4ffa-b83b-521b9af177fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83a5fb2-aa58-46b7-8e70-d0a790aeb141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f83a5fb2-aa58-46b7-8e70-d0a790aeb141) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '728cca08-7685-4217-aca6-b53049585449', 'volume_name': 'volume-728cca08-7685-4217-aca6-b53049585449', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb47ccd-621e-4a72-b227-6a5d77cf03d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb47ccd-621e-4a72-b227-6a5d77cf03d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400db858-a126-4e7a-9597-a4ec163720bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:19 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume 728cca08-7685-4217-aca6-b53049585449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-728cca08-7685-4217-aca6-b53049585449', 'volume_size': 1} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (20bf3dba-aab1-4f36-a607-3dc499b21e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32619f8b-d724-468a-b16d-e84940b14a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32619f8b-d724-468a-b16d-e84940b14a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-638497920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7e5f3d-99a2-4060-976d-6e18f8c3362a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:20Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9403197-279e-487f-a16f-f327f3a9ee1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9403197-279e-487f-a16f-f327f3a9ee1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4732249e-3847-4dc8-963c-07f14dbd1d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4732249e-3847-4dc8-963c-07f14dbd1d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b7e5f3d-99a2-4060-976d-6e18f8c3362a', 'volume_name': 'volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2c9a79-3ae2-4e2f-8381-6dbd28fe6b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b2c9a79-3ae2-4e2f-8381-6dbd28fe6b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad0045b-b873-4ed4-8a10-3dc0befd27dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume 8b7e5f3d-99a2-4060-976d-6e18f8c3362a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a', 'volume_size': 1} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (8783f838-f59e-469e-9e01-fdb8c759a68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e794a7-86c9-4c7c-8dd6-0a1c692af3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96e794a7-86c9-4c7c-8dd6-0a1c692af3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1686844409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea958a2d-37b9-4731-9cbf-c3acca74ab44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:20Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f5c909-89ca-4b42-86f7-25e3d34b1d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35f5c909-89ca-4b42-86f7-25e3d34b1d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca95aea9-3ba1-4825-9d70-cbb12dcecbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca95aea9-3ba1-4825-9d70-cbb12dcecbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea958a2d-37b9-4731-9cbf-c3acca74ab44', 'volume_name': 'volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6a29e1-525d-46d0-8e80-230299291a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e6a29e1-525d-46d0-8e80-230299291a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a3ac2a-b097-47f3-82ef-4ea6f8a1d124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume ea958a2d-37b9-4731-9cbf-c3acca74ab44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44', 'volume_size': 1} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:20 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 1G" returned: 0 in 0.844s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e68794-5adb-4203-997f-d8a310eb2483 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:20 devstack sudo[89528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e68794-5adb-4203-997f-d8a310eb2483 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 Apr 22 09:27:20 devstack sudo[89528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (a11cdca8-e945-450a-8fce-c26191b66add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c36ee3-f4a2-40df-91a6-7d973d5e527c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63c36ee3-f4a2-40df-91a6-7d973d5e527c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-106100219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e24586-b834-41f0-a605-4f760277444c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:20Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883d4622-4860-443b-86b9-122963e4134b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (883d4622-4860-443b-86b9-122963e4134b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6936e6-a18d-4747-bbc5-3d3e2d1a11df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec6936e6-a18d-4747-bbc5-3d3e2d1a11df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46e24586-b834-41f0-a605-4f760277444c', 'volume_name': 'volume-46e24586-b834-41f0-a605-4f760277444c', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4b4c58-81e3-4725-9c97-b606d271a227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de4b4c58-81e3-4725-9c97-b606d271a227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523ff786-1d95-4eda-b571-b7a5cd81328b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume 46e24586-b834-41f0-a605-4f760277444c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46e24586-b834-41f0-a605-4f760277444c', 'volume_size': 1} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (8316a139-65f5-4948-8551-f4bdea462323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90815b0a-fcdb-4a21-a15b-32b412e4cb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90815b0a-fcdb-4a21-a15b-32b412e4cb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2079322227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80c3627-28a0-425c-9dd1-ca67671350c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:21Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ea6327-8798-4421-a31e-7356740e6b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ea6327-8798-4421-a31e-7356740e6b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d1c47d-4d70-459c-9d8c-70c8f5f9d370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72d1c47d-4d70-459c-9d8c-70c8f5f9d370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a80c3627-28a0-425c-9dd1-ca67671350c7', 'volume_name': 'volume-a80c3627-28a0-425c-9dd1-ca67671350c7', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0704491c-c4c9-4916-9c7f-9e261b114527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0704491c-c4c9-4916-9c7f-9e261b114527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e448ab-7586-4342-9f03-b6d806fc9f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:20 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume a80c3627-28a0-425c-9dd1-ca67671350c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a80c3627-28a0-425c-9dd1-ca67671350c7', 'volume_size': 1} Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:20 devstack sudo[89528]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52e68794-5adb-4203-997f-d8a310eb2483 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8" returned: 0 in 0.485s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:20 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 is being set with open permissions: ugo+rw Apr 22 09:27:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:20 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 Apr 22 09:27:20 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Flow 'volume_create_manager' (371a6df8-76a1-4075-9154-969d6c5ba425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f5855f-4102-4f92-a5a3-9c28a50fbd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58f5855f-4102-4f92-a5a3-9c28a50fbd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1754006288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d61acd-55d8-426d-aae1-e13cea92f888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64481976cca47928f6de57439e16508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:21Z,use_quota=True,user_id='2380454386074af1b1ffd309eb058de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ba69c7-e810-46d3-b0ad-ffd42d4644e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2ba69c7-e810-46d3-b0ad-ffd42d4644e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcae9b1-2086-4dfa-8731-f1b875125b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fcae9b1-2086-4dfa-8731-f1b875125b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76d61acd-55d8-426d-aae1-e13cea92f888', 'volume_name': 'volume-76d61acd-55d8-426d-aae1-e13cea92f888', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4777b641-41f3-4fc0-870b-63b217e79933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4777b641-41f3-4fc0-870b-63b217e79933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c64eba-be7c-4a87-9811-a0d30467fbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Volume 76d61acd-55d8-426d-aae1-e13cea92f888: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76d61acd-55d8-426d-aae1-e13cea92f888', 'volume_size': 1} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Flow 'volume_create_manager' (30dc5c12-5f26-4222-8fed-8ed75d7ab887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4643ee-22a6-4e20-a64c-c34668d47fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe4643ee-22a6-4e20-a64c-c34668d47fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432184555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dec04f-1dd9-4b80-9931-f68b8ec8165b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64481976cca47928f6de57439e16508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:21Z,use_quota=True,user_id='2380454386074af1b1ffd309eb058de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8c37a0-48ba-40fc-8dba-b32a9094909e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a8c37a0-48ba-40fc-8dba-b32a9094909e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f98dc4-4d37-4bc3-bb83-e766f34053e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7f98dc4-4d37-4bc3-bb83-e766f34053e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92dec04f-1dd9-4b80-9931-f68b8ec8165b', 'volume_name': 'volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca27266b-c423-4fc7-af92-4eb875bcc534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca27266b-c423-4fc7-af92-4eb875bcc534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ecfbb2-176a-489b-be82-6ce2afc5c7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Volume 92dec04f-1dd9-4b80-9931-f68b8ec8165b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b', 'volume_size': 1} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Flow 'volume_create_manager' (0f9b6b09-c131-415b-a63b-35f2fba3e692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc002d1d-c20a-43e1-b2f2-91ea74929cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc002d1d-c20a-43e1-b2f2-91ea74929cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123146842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9477ab2e-757f-47a6-b284-2a786e3ab21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64481976cca47928f6de57439e16508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:21Z,use_quota=True,user_id='2380454386074af1b1ffd309eb058de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc80e71-dd65-4253-b51d-5643c2b16a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecc80e71-dd65-4253-b51d-5643c2b16a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3533d094-af2b-4e9a-84e7-bd2c1f45423c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3533d094-af2b-4e9a-84e7-bd2c1f45423c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9477ab2e-757f-47a6-b284-2a786e3ab21f', 'volume_name': 'volume-9477ab2e-757f-47a6-b284-2a786e3ab21f', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12bacc7-3766-4ce2-9847-1261fedc94c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12bacc7-3766-4ce2-9847-1261fedc94c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df5619d-c497-4edf-a0b1-196cd6e66dae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Volume 9477ab2e-757f-47a6-b284-2a786e3ab21f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9477ab2e-757f-47a6-b284-2a786e3ab21f', 'volume_size': 1} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:21 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8" returned: 0 in 0.628s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:21 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.info Apr 22 09:27:21 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Flow 'volume_create_manager' (8912d15f-5667-443e-8a8f-c08a96488a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6419acaa-cfcb-45a6-a314-c8c8a5ac4fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6419acaa-cfcb-45a6-a314-c8c8a5ac4fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-239362894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c920a2-e288-4456-89a5-a33683e93afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64481976cca47928f6de57439e16508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:22Z,use_quota=True,user_id='2380454386074af1b1ffd309eb058de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5225f16d-6a5d-450f-b56d-214b73336cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5225f16d-6a5d-450f-b56d-214b73336cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea50483-34be-473a-a2b6-87b3db2b13e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ea50483-34be-473a-a2b6-87b3db2b13e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89c920a2-e288-4456-89a5-a33683e93afb', 'volume_name': 'volume-89c920a2-e288-4456-89a5-a33683e93afb', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6aa24f-ba8b-4f84-ac1e-58f17c3cd6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6aa24f-ba8b-4f84-ac1e-58f17c3cd6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ce1f77-88ba-4471-a275-abf573d2e3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Volume 89c920a2-e288-4456-89a5-a33683e93afb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89c920a2-e288-4456-89a5-a33683e93afb', 'volume_size': 1} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Flow 'volume_create_manager' (3079905b-d5cc-4320-bb25-436484a04014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bceb549-7c45-45bb-9009-e92365db97f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bceb549-7c45-45bb-9009-e92365db97f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-779930356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9175f13a-3e83-48f0-8f2f-28290198457f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64481976cca47928f6de57439e16508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:22Z,use_quota=True,user_id='2380454386074af1b1ffd309eb058de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606d3bf3-72a6-4209-a2bd-a8729a111dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (606d3bf3-72a6-4209-a2bd-a8729a111dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb2b64c-f453-4383-a3ba-a0f971af160f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bb2b64c-f453-4383-a3ba-a0f971af160f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9175f13a-3e83-48f0-8f2f-28290198457f', 'volume_name': 'volume-9175f13a-3e83-48f0-8f2f-28290198457f', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe903c3-f89c-488c-b505-6b69672f8e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe903c3-f89c-488c-b505-6b69672f8e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0136ee07-c894-4773-ad1b-8754b94b41a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:21 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Volume 9175f13a-3e83-48f0-8f2f-28290198457f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9175f13a-3e83-48f0-8f2f-28290198457f', 'volume_size': 1} Apr 22 09:27:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:22 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.info" returned: 0 in 0.598s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:22 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.info is being set with open permissions: ugo+rw Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:22 devstack sudo[89541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.info Apr 22 09:27:22 devstack sudo[89541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:22 devstack sudo[89541]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.info" returned: 0 in 0.463s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Acquiring lock "cinder-quobyte-3a8a3786-c238-4481-8ff4-d48ffb97d4be" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Lock "cinder-quobyte-3a8a3786-c238-4481-8ff4-d48ffb97d4be" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] snapshot: cae2fd8e-cde1-48cf-b90c-20c1ded433c8, volume: 3a8a3786-c238-4481-8ff4-d48ffb97d4be, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[633e83b7-3de3-4f5a-9485-714b2961f663]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:22 devstack sudo[89544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 Apr 22 09:27:22 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:23 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8" returned: 0 in 0.531s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52e68794-5adb-4203-997f-d8a310eb2483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:27:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:27:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:27:23 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[26306622-5c7b-422d-b248-56f6699bb413]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:23 devstack sudo[89550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 Apr 22 09:27:23 devstack sudo[89550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:23 devstack sudo[89550]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483" returned: 0 in 0.504s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:23 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:27:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:23 devstack sudo[89555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be Apr 22 09:27:23 devstack sudo[89555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:25 devstack sudo[89555]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be" returned: 0 in 2.156s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:25 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[45251433-f549-491a-87ad-bb832803f6c5]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:25 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 Apr 22 09:27:25 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:26 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483" returned: 0 in 0.719s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:26 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483, size 1024.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:27:26 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Converted 1024.00 MB image at 474.49 MB/s Apr 22 09:27:26 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be is being set with open permissions: ugo+rw Apr 22 09:27:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:26 devstack sudo[89573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be Apr 22 09:27:26 devstack sudo[89573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:27 devstack sudo[89573]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be" returned: 0 in 0.496s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Lock "cinder-quobyte-3a8a3786-c238-4481-8ff4-d48ffb97d4be" released by "_copy_volume_from_snapshot" :: held 4.460s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Acquiring lock "cinder-quobyte-cae2fd8e-cde1-48cf-b90c-20c1ded433c8" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Lock "cinder-quobyte-cae2fd8e-cde1-48cf-b90c-20c1ded433c8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Deleting offline snapshot cae2fd8e-cde1-48cf-b90c-20c1ded433c8 of volume 52e68794-5adb-4203-997f-d8a310eb2483 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] snapshot_file for this snap is: volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e11b3b-06c0-4201-8264-9b1899b25ad0]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:27 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 Apr 22 09:27:27 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:27 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8" returned: 0 in 0.555s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52e68794-5adb-4203-997f-d8a310eb2483(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[de853977-c517-44fa-bad5-ab47560ae049]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:27 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 Apr 22 09:27:27 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:28 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483" returned: 0 in 0.574s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:28 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 Apr 22 09:27:28 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:28 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8" returned: 0 in 0.523s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:28 devstack sudo[89592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8 Apr 22 09:27:28 devstack sudo[89592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:29 devstack sudo[89592]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483.cae2fd8e-cde1-48cf-b90c-20c1ded433c8" returned: 0 in 0.420s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Lock "cinder-quobyte-cae2fd8e-cde1-48cf-b90c-20c1ded433c8" released by "_delete_snapshot" :: held 2.130s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.299s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.419s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-941880385',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=728cca08-7685-4217-aca6-b53049585449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:20Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Creating volume 728cca08-7685-4217-aca6-b53049585449 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:29 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64a176fc-f477-4b37-93d8-5c9f03dd3276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be', 'volume_size': 2, 'source_volid': '52e68794-5adb-4203-997f-d8a310eb2483', 'source_volstatus': 'available'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6aac79-c538-4d25-9e12-340b1c38cbb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:29 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449 1073741824 Apr 22 09:27:29 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:29 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Volume volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be (3a8a3786-c238-4481-8ff4-d48ffb97d4be): created successfully Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c6aac79-c538-4d25-9e12-340b1c38cbb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Flow 'volume_create_manager' (aa86df53-a447-4dda-89ae-9485fec025ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:29 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0cc335fe-cfed-416d-997a-f36204ffe34f tempest-VolumesCloneTest-1536448227 None] Created volume successfully. Apr 22 09:27:29 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449 1073741824" returned: 0 in 0.563s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:29 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449 Apr 22 09:27:29 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:30 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449" returned: 0 in 0.473s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.272s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-638497920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b7e5f3d-99a2-4060-976d-6e18f8c3362a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:20Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Creating volume 8b7e5f3d-99a2-4060-976d-6e18f8c3362a {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:30 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400db858-a126-4e7a-9597-a4ec163720bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-728cca08-7685-4217-aca6-b53049585449', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236db7ff-195f-4739-aaa5-3fa64ad155bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:30 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a 1073741824 Apr 22 09:27:30 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume volume-728cca08-7685-4217-aca6-b53049585449 (728cca08-7685-4217-aca6-b53049585449): created successfully Apr 22 09:27:30 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236db7ff-195f-4739-aaa5-3fa64ad155bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (36a1cda1-ff31-4373-b00f-ed2ab033195b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:30 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-533c492f-b311-4f49-bf6b-83bbc94a9cb9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created volume successfully. Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Acquiring lock "cinder-3a8a3786-c238-4481-8ff4-d48ffb97d4be-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Lock "cinder-3a8a3786-c238-4481-8ff4-d48ffb97d4be-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=146,cinder:UPDATE=182,cinder:INSERT=52,cinder:DELETE=19 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Acquiring lock "cinder-quobyte-3a8a3786-c238-4481-8ff4-d48ffb97d4be" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Lock "cinder-quobyte-3a8a3786-c238-4481-8ff4-d48ffb97d4be" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f025a7c-d84e-449b-9936-7301fe9d3cd0]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:30 devstack sudo[89605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be Apr 22 09:27:30 devstack sudo[89605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_service.periodic_task [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:30 devstack sudo[89607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:30 devstack sudo[89607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:30 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a 1073741824" returned: 0 in 0.638s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:30 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a Apr 22 09:27:30 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:31 devstack sudo[89607]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.458s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:31 devstack sudo[89605]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be" returned: 0 in 0.605s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:31 devstack sudo[89619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be Apr 22 09:27:31 devstack sudo[89619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:31 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a" returned: 0 in 0.458s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.120s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1686844409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea958a2d-37b9-4731-9cbf-c3acca74ab44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:20Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Creating volume ea958a2d-37b9-4731-9cbf-c3acca74ab44 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:31 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad0045b-b873-4ed4-8a10-3dc0befd27dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e28d4a-837e-475c-8442-3af02c0da37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:31 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44 1073741824 Apr 22 09:27:31 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:31 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a (8b7e5f3d-99a2-4060-976d-6e18f8c3362a): created successfully Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29e28d4a-837e-475c-8442-3af02c0da37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (20bf3dba-aab1-4f36-a607-3dc499b21e55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:31 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-1800b70d-3ac6-46d8-89ab-bbf1d1fb8aa3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created volume successfully. Apr 22 09:27:31 devstack sudo[89619]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a8a3786-c238-4481-8ff4-d48ffb97d4be" returned: 0 in 0.494s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Lock "cinder-quobyte-3a8a3786-c238-4481-8ff4-d48ffb97d4be" released by "delete_volume" :: held 1.131s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Created reservations ['b9a58031-dab6-457b-abf0-1d3e82bad009', '24c4e984-f777-4ba2-8ea6-610982fc05dc', '6180f3ea-cbb5-49a2-a36a-d6c6af8b8299', 'c7b1e147-9d5b-4c1a-a270-f3e6eb757aee'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:31 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:31 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:32 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44 1073741824" returned: 0 in 0.581s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=160,cinder:INSERT=45,cinder:UPDATE=207,cinder:DELETE=13 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:32 devstack sudo[89630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44 Apr 22 09:27:32 devstack sudo[89630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:32 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.476s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:32 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Deleted volume successfully. Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d23d1fe7-a4f2-4826-b715-98ce64e366f0 tempest-VolumesCloneTest-1536448227 None] Lock "cinder-3a8a3786-c238-4481-8ff4-d48ffb97d4be-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:32 devstack sudo[89630]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44" returned: 0 in 0.444s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.829s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-106100219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46e24586-b834-41f0-a605-4f760277444c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:20Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Creating volume 46e24586-b834-41f0-a605-4f760277444c {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:32 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3a3ac2a-b097-47f3-82ef-4ea6f8a1d124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b022d3-1220-4448-8e41-4f90206451ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:32 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c 1073741824 Apr 22 09:27:32 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:32 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44 (ea958a2d-37b9-4731-9cbf-c3acca74ab44): created successfully Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1b022d3-1220-4448-8e41-4f90206451ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (8783f838-f59e-469e-9e01-fdb8c759a68e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:32 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4e1937c8-c4a7-4c18-be37-20a37a7d58d6 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created volume successfully. Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Acquiring lock "cinder-52e68794-5adb-4203-997f-d8a310eb2483-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Lock "cinder-52e68794-5adb-4203-997f-d8a310eb2483-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Acquiring lock "cinder-quobyte-52e68794-5adb-4203-997f-d8a310eb2483" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Lock "cinder-quobyte-52e68794-5adb-4203-997f-d8a310eb2483" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc05414d-cc34-497e-a3c6-e4a869d4f939]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:32 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 Apr 22 09:27:32 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:33 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c 1073741824" returned: 0 in 0.575s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:33 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c Apr 22 09:27:33 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:33 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483" returned: 0 in 0.574s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:33 devstack sudo[89652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483 Apr 22 09:27:33 devstack sudo[89652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:33 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c" returned: 0 in 0.543s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] <== create_volume: return (1143ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.146s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.856s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2079322227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80c3627-28a0-425c-9dd1-ca67671350c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92f0253b44da42b8adda08fbb86ecab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:21Z,use_quota=True,user_id='716b0bab898441369136c92d34ded71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Creating volume a80c3627-28a0-425c-9dd1-ca67671350c7 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:33 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (523ff786-1d95-4eda-b571-b7a5cd81328b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46e24586-b834-41f0-a605-4f760277444c', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f88b10-e360-4fdb-91f2-9333f2aae539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:33 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume volume-46e24586-b834-41f0-a605-4f760277444c (46e24586-b834-41f0-a605-4f760277444c): created successfully Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f88b10-e360-4fdb-91f2-9333f2aae539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:33 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7 1073741824 Apr 22 09:27:33 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (a11cdca8-e945-450a-8fce-c26191b66add) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:33 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6a84e035-1d16-4067-9520-fea9f47abbb1 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created volume successfully. Apr 22 09:27:33 devstack sudo[89652]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-52e68794-5adb-4203-997f-d8a310eb2483" returned: 0 in 0.515s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Lock "cinder-quobyte-52e68794-5adb-4203-997f-d8a310eb2483" released by "delete_volume" :: held 1.121s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Created reservations ['5743eea9-ddbe-45bc-a7ee-d0cb9c8e6850', 'e655d072-69d2-4e9c-b3ca-981a665aa908', '287d4217-d180-4b65-aa99-cffca269c11f', '06419da5-8a8b-4863-9eb4-fb644c06794f'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:34 devstack sudo[89658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:34 devstack sudo[89658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:34 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7 1073741824" returned: 0 in 0.587s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:34 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7 Apr 22 09:27:34 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:34 devstack sudo[89658]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.537s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:34 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Deleted volume successfully. Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a543a316-0cde-43fc-8ff4-758c7ff2aaa1 tempest-VolumesCloneTest-1536448227 None] Lock "cinder-52e68794-5adb-4203-997f-d8a310eb2483-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:34 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7" returned: 0 in 0.453s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.631s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1754006288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76d61acd-55d8-426d-aae1-e13cea92f888,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64481976cca47928f6de57439e16508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:21Z,use_quota=True,user_id='2380454386074af1b1ffd309eb058de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Creating volume 76d61acd-55d8-426d-aae1-e13cea92f888 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:34 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e448ab-7586-4342-9f03-b6d806fc9f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a80c3627-28a0-425c-9dd1-ca67671350c7', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:34 devstack sudo[89667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888 1073741824 Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b30343b-d515-4812-b7c3-83debd55ced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:34 devstack sudo[89667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:34 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Volume volume-a80c3627-28a0-425c-9dd1-ca67671350c7 (a80c3627-28a0-425c-9dd1-ca67671350c7): created successfully Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b30343b-d515-4812-b7c3-83debd55ced9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Flow 'volume_create_manager' (8316a139-65f5-4948-8551-f4bdea462323) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:34 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4adc521c-2397-4fd1-b659-f29c10319800 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created volume successfully. Apr 22 09:27:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-a80c3627-28a0-425c-9dd1-ca67671350c7-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-a80c3627-28a0-425c-9dd1-ca67671350c7-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-quobyte-a80c3627-28a0-425c-9dd1-ca67671350c7" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-a80c3627-28a0-425c-9dd1-ca67671350c7" acquired by "delete_volume" :: waited 0.022s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:35 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8468c423-5e34-42fd-9f3e-b178af1df6b6]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:35 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7 Apr 22 09:27:35 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:35 devstack sudo[89667]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888 1073741824" returned: 0 in 0.718s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:35 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888 Apr 22 09:27:35 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:35 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7" returned: 0 in 0.654s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:35 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7 Apr 22 09:27:35 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:36 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888" returned: 0 in 0.565s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.319s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.695s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432184555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dec04f-1dd9-4b80-9931-f68b8ec8165b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64481976cca47928f6de57439e16508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:21Z,use_quota=True,user_id='2380454386074af1b1ffd309eb058de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Creating volume 92dec04f-1dd9-4b80-9931-f68b8ec8165b {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:36 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c64eba-be7c-4a87-9811-a0d30467fbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76d61acd-55d8-426d-aae1-e13cea92f888', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f373fe-5af9-44b9-bf87-d72478f69061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:36 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b 1073741824 Apr 22 09:27:36 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:36 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Volume volume-76d61acd-55d8-426d-aae1-e13cea92f888 (76d61acd-55d8-426d-aae1-e13cea92f888): created successfully Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52f373fe-5af9-44b9-bf87-d72478f69061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Flow 'volume_create_manager' (371a6df8-76a1-4075-9154-969d6c5ba425) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:36 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-a1a03492-cc8c-4642-bf50-0d1285d51543 tempest-CreateVolumesFromImageTest-1560799293 None] Created volume successfully. Apr 22 09:27:36 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a80c3627-28a0-425c-9dd1-ca67671350c7" returned: 0 in 0.507s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-a80c3627-28a0-425c-9dd1-ca67671350c7" released by "delete_volume" :: held 1.196s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created reservations ['4158490d-936b-4302-8680-f66af1bc6022', 'b0097f86-2073-4be7-9070-453ca028693d', '94f8bd8e-807c-434b-94bc-8f3a4774e326', '01448756-5217-4d66-9bdc-9ef791bb75c0'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:36 devstack sudo[89685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:36 devstack sudo[89685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:36 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b 1073741824" returned: 0 in 0.846s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:36 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b Apr 22 09:27:36 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:37 devstack sudo[89685]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.719s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:37 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Deleted volume successfully. Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-909e7b25-dcc1-46bf-b61d-1aba7ecdab49 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-a80c3627-28a0-425c-9dd1-ca67671350c7-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-46e24586-b834-41f0-a605-4f760277444c-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-46e24586-b834-41f0-a605-4f760277444c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-quobyte-46e24586-b834-41f0-a605-4f760277444c" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-46e24586-b834-41f0-a605-4f760277444c" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e236233-db55-4175-b91e-4f36f7de0dd3]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:37 devstack sudo[89693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c Apr 22 09:27:37 devstack sudo[89693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:37 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b" returned: 0 in 0.625s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] <== create_volume: return (1515ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.088s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2123146842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9477ab2e-757f-47a6-b284-2a786e3ab21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64481976cca47928f6de57439e16508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:21Z,use_quota=True,user_id='2380454386074af1b1ffd309eb058de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Creating volume 9477ab2e-757f-47a6-b284-2a786e3ab21f {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:37 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:37 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f 1073741824 Apr 22 09:27:37 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2ecfbb2-176a-489b-be82-6ce2afc5c7ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0035c13-e286-4952-813b-725fb5d8377b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:37 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Volume volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b (92dec04f-1dd9-4b80-9931-f68b8ec8165b): created successfully Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0035c13-e286-4952-813b-725fb5d8377b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Flow 'volume_create_manager' (30dc5c12-5f26-4222-8fed-8ed75d7ab887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:37 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e16f42bf-8d13-4486-a6f1-3fc3b41a38d3 tempest-CreateVolumesFromImageTest-1560799293 None] Created volume successfully. Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Flow 'volume_create_manager' (9b090661-b1de-4f5d-be8f-2f6686e12930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c8e49e-5438-4ff2-85d5-c4fc039a8a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61c8e49e-5438-4ff2-85d5-c4fc039a8a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1008073417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312ff1a2-3c45-4b1d-bbe4-69c4495b4021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac53dce68b2b436c935975967f1d6cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:38Z,use_quota=True,user_id='22ac19ce029a4f78a12783eeec115956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1609fe3f-a28f-423e-8b64-832da7937731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1609fe3f-a28f-423e-8b64-832da7937731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5691ed4-576b-4c93-98ac-62cc6c273d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5691ed4-576b-4c93-98ac-62cc6c273d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '312ff1a2-3c45-4b1d-bbe4-69c4495b4021', 'volume_name': 'volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ce7769-2024-45f9-bf54-15e6a6900267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6ce7769-2024-45f9-bf54-15e6a6900267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7513a057-8756-4e36-a7ad-b5a6cb46b3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:37 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume 312ff1a2-3c45-4b1d-bbe4-69c4495b4021: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021', 'volume_size': 1} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Flow 'volume_create_manager' (3c575f0a-469e-4d37-99a7-1beaaff2f755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbfe04b-0bf3-4e72-93c4-bc9a1408499f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4fbfe04b-0bf3-4e72-93c4-bc9a1408499f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-219689124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22c592a-0c49-4588-bf64-dfdfa85eb3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bfdb38f1304361a07b92d85564e316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:38Z,use_quota=True,user_id='8e3daf2e258c4af9bcdeb09a5f02a003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d74ca4-641d-446b-a625-bdb30cac6eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54d74ca4-641d-446b-a625-bdb30cac6eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdd737d-2fb1-40e6-860a-08483e046e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG cinder.image.glance [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Creating Keystone auth plugin from conf {{(pid=82642) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 22 09:27:37 devstack sudo[89693]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c" returned: 0 in 0.633s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:37 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c Apr 22 09:27:37 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fdd737d-2fb1-40e6-860a-08483e046e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c22c592a-0c49-4588-bf64-dfdfa85eb3ef', 'volume_name': 'volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cd261e-15c9-4454-bf80-dd0ab22f05d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01cd261e-15c9-4454-bf80-dd0ab22f05d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61687d98-e3aa-4592-b17e-a65a41c44cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:38 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Volume c22c592a-0c49-4588-bf64-dfdfa85eb3ef: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Trying to clone c22c592a-0c49-4588-bf64-dfdfa85eb3ef from image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]). {{(pid=82642) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:736}} Apr 22 09:27:38 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Image download 20.69 MB at 20.69 MB/s Apr 22 09:27:38 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1d86f7-3163-4eab-8c7c-4d2c2f64775c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f 1073741824" returned: 0 in 0.680s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:38 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f Apr 22 09:27:38 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:38 devstack sudo[89716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD Apr 22 09:27:38 devstack sudo[89716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:38 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-46e24586-b834-41f0-a605-4f760277444c" returned: 0 in 0.570s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-46e24586-b834-41f0-a605-4f760277444c" released by "delete_volume" :: held 1.237s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created reservations ['4c2ee753-912d-4124-bb32-f48ed63140dd', '56c9f05d-0241-4e97-82d0-c4d2ba0fa7ab', '6d207501-70cc-4812-9126-cf1bf6d5fb80', '34e33d3e-419f-4761-8cf7-c38d0c80fbbd'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:38 devstack sudo[89746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:38 devstack sudo[89746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:38 devstack sudo[89716]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD" returned: 0 in 0.508s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Temporary image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b is fetched for user 8e3daf2e258c4af9bcdeb09a5f02a003. {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:1439}} Apr 22 09:27:38 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f" returned: 0 in 0.494s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] <== create_volume: return (1206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.068s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-239362894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89c920a2-e288-4456-89a5-a33683e93afb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64481976cca47928f6de57439e16508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:22Z,use_quota=True,user_id='2380454386074af1b1ffd309eb058de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Creating volume 89c920a2-e288-4456-89a5-a33683e93afb {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:38 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7df5619d-c497-4edf-a0b1-196cd6e66dae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9477ab2e-757f-47a6-b284-2a786e3ab21f', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:38 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb 1073741824 Apr 22 09:27:38 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7dfb3a-3799-4f70-8ee4-ae14cbb986fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:38 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Volume volume-9477ab2e-757f-47a6-b284-2a786e3ab21f (9477ab2e-757f-47a6-b284-2a786e3ab21f): created successfully Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d7dfb3a-3799-4f70-8ee4-ae14cbb986fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Flow 'volume_create_manager' (0f9b6b09-c131-415b-a63b-35f2fba3e692) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1157d26-3e4b-4a9b-978d-bfdd26a7aed2]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:38 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-37a4b211-9fa1-436b-93c8-ad2b14e36669 tempest-CreateVolumesFromImageTest-1560799293 None] Created volume successfully. Apr 22 09:27:38 devstack sudo[89754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD Apr 22 09:27:38 devstack sudo[89754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:39 devstack sudo[89746]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.444s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:39 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Deleted volume successfully. Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-39a7d895-df5a-4eb1-936c-34d0b1c35d3f tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-46e24586-b834-41f0-a605-4f760277444c-delete_volume" released by "delete_volume" :: held 1.812s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:39 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb 1073741824" returned: 0 in 0.502s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:39 devstack sudo[89754]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:39 devstack sudo[89763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb Apr 22 09:27:39 devstack sudo[89763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-ea958a2d-37b9-4731-9cbf-c3acca74ab44-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-ea958a2d-37b9-4731-9cbf-c3acca74ab44-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-quobyte-ea958a2d-37b9-4731-9cbf-c3acca74ab44" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-ea958a2d-37b9-4731-9cbf-c3acca74ab44" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e2161b-f6a8-42ff-a23a-0e1837aa89e6]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:39 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44 Apr 22 09:27:39 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:39 devstack sudo[89763]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb" returned: 0 in 0.441s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 17.781s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-779930356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9175f13a-3e83-48f0-8f2f-28290198457f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d64481976cca47928f6de57439e16508',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:22Z,use_quota=True,user_id='2380454386074af1b1ffd309eb058de3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Creating volume 9175f13a-3e83-48f0-8f2f-28290198457f {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:39 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7ce1f77-88ba-4471-a275-abf573d2e3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89c920a2-e288-4456-89a5-a33683e93afb', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:39 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f 1073741824 Apr 22 09:27:39 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c012ef1-81b2-4682-bf94-635406bffc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:39 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Volume volume-89c920a2-e288-4456-89a5-a33683e93afb (89c920a2-e288-4456-89a5-a33683e93afb): created successfully Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c012ef1-81b2-4682-bf94-635406bffc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Flow 'volume_create_manager' (8912d15f-5667-443e-8a8f-c08a96488a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:39 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f80a4cb9-423b-4dc4-8c91-c1d851a869e8 tempest-CreateVolumesFromImageTest-1560799293 None] Created volume successfully. Apr 22 09:27:39 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44" returned: 0 in 0.516s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:40 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44 Apr 22 09:27:40 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:40 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f 1073741824" returned: 0 in 0.499s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:40 devstack sudo[89778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f Apr 22 09:27:40 devstack sudo[89778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:40 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ea958a2d-37b9-4731-9cbf-c3acca74ab44" returned: 0 in 0.462s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-ea958a2d-37b9-4731-9cbf-c3acca74ab44" released by "delete_volume" :: held 1.002s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created reservations ['bfd3bcca-9384-42be-9e70-0d9d1db7ebe7', '694fde82-2853-4804-8d18-c90da36e8ac6', '4b542ada-630a-43a1-ae88-345fbac7e7de', '92191ce0-02b3-4948-9ba9-73873680987a'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:40 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:40 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:40 devstack sudo[89778]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f" returned: 0 in 0.411s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.032s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1008073417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=312ff1a2-3c45-4b1d-bbe4-69c4495b4021,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac53dce68b2b436c935975967f1d6cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:38Z,use_quota=True,user_id='22ac19ce029a4f78a12783eeec115956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Creating volume 312ff1a2-3c45-4b1d-bbe4-69c4495b4021 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:40 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0136ee07-c894-4773-ad1b-8754b94b41a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9175f13a-3e83-48f0-8f2f-28290198457f', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:40 devstack sudo[89784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 1073741824 Apr 22 09:27:40 devstack sudo[89784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4473889-725b-4a9a-bdd2-85eefe8b1ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:40 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Volume volume-9175f13a-3e83-48f0-8f2f-28290198457f (9175f13a-3e83-48f0-8f2f-28290198457f): created successfully Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4473889-725b-4a9a-bdd2-85eefe8b1ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Flow 'volume_create_manager' (3079905b-d5cc-4320-bb25-436484a04014) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:40 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-79c2ac49-7a8a-444c-ae7d-763cb5edde4e tempest-CreateVolumesFromImageTest-1560799293 None] Created volume successfully. Apr 22 09:27:40 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.421s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:40 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Deleted volume successfully. Apr 22 09:27:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-322906c2-60b5-4dbd-aead-f8c477581be9 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-ea958a2d-37b9-4731-9cbf-c3acca74ab44-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:41 devstack sudo[89784]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 1073741824" returned: 0 in 0.499s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:41 devstack sudo[89791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 Apr 22 09:27:41 devstack sudo[89791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "cinder-9175f13a-3e83-48f0-8f2f-28290198457f-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-9175f13a-3e83-48f0-8f2f-28290198457f-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "cinder-quobyte-9175f13a-3e83-48f0-8f2f-28290198457f" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-8b7e5f3d-99a2-4060-976d-6e18f8c3362a-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-quobyte-9175f13a-3e83-48f0-8f2f-28290198457f" acquired by "delete_volume" :: waited 0.018s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-8b7e5f3d-99a2-4060-976d-6e18f8c3362a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[522a1096-cdf5-4741-b02e-3fad929b859f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-quobyte-8b7e5f3d-99a2-4060-976d-6e18f8c3362a" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-8b7e5f3d-99a2-4060-976d-6e18f8c3362a" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61526ad-4d8e-4dde-85cf-06b893ad92ce]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:41 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f Apr 22 09:27:41 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:41 devstack sudo[89791]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021" returned: 0 in 0.459s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.385s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-219689124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c22c592a-0c49-4588-bf64-dfdfa85eb3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bfdb38f1304361a07b92d85564e316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:38Z,use_quota=True,user_id='8e3daf2e258c4af9bcdeb09a5f02a003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Creating volume c22c592a-0c49-4588-bf64-dfdfa85eb3ef {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:41 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:41 devstack sudo[89795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a Apr 22 09:27:41 devstack sudo[89795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7513a057-8756-4e36-a7ad-b5a6cb46b3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce93ff6-d54d-45a4-a733-90ac1b37f20a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:41 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 (312ff1a2-3c45-4b1d-bbe4-69c4495b4021): created successfully Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ce93ff6-d54d-45a4-a733-90ac1b37f20a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:41 devstack sudo[89797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef 1073741824 Apr 22 09:27:41 devstack sudo[89797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Flow 'volume_create_manager' (9b090661-b1de-4f5d-be8f-2f6686e12930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:41 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ec9c7c1f-9259-4006-bd0b-b08df7660b91 tempest-VolumesSnapshotTestJSON-1069919655 None] Created volume successfully. Apr 22 09:27:42 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f" returned: 0 in 0.497s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:42 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f Apr 22 09:27:42 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:42 devstack sudo[89795]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a" returned: 0 in 0.570s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:42 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a Apr 22 09:27:42 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:42 devstack sudo[89797]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef 1073741824" returned: 0 in 0.550s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:42 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef Apr 22 09:27:42 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:42 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9175f13a-3e83-48f0-8f2f-28290198457f" returned: 0 in 0.493s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-quobyte-9175f13a-3e83-48f0-8f2f-28290198457f" released by "delete_volume" :: held 1.015s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Created reservations ['45a1cdc4-563b-4800-9494-2c6645cf0f1b', '0d4b74a1-92e1-4c3c-bff7-23992a10363b', 'a8082ab8-9188-46e0-b4bb-afd42d1420f4', 'd6cbea5c-82fc-45ba-82d6-a2e17d55afbb'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:42 devstack sudo[89818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:42 devstack sudo[89818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:42 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8b7e5f3d-99a2-4060-976d-6e18f8c3362a" returned: 0 in 0.497s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:42 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" returned: 0 in 0.453s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-8b7e5f3d-99a2-4060-976d-6e18f8c3362a" released by "delete_volume" :: held 1.104s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Attempting download of 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b ((None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}])) to volume c22c592a-0c49-4588-bf64-dfdfa85eb3ef. {{(pid=82642) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created reservations ['7646deeb-9ea3-43d7-93f3-60b699a8c8a2', 'd3936902-6406-4895-9474-79c3d4bb7918', 'e61bf347-29bd-4c16-b394-2527de67b1c6', '37eb3f73-2dc8-4d8e-ac7f-63ae7e8326f9'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba6f12d-2daf-48f9-88e6-18c424c1f25f]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_2o0rbsyx {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:42 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_2o0rbsyx Apr 22 09:27:42 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:42 devstack sudo[89821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:42 devstack sudo[89821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] Creating offline snapshot f22a016b-e568-40f5-bb6f-5211d6263cea of volume 312ff1a2-3c45-4b1d-bbe4-69c4495b4021 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc64b512-1a87-4c11-bac1-92cb8a38d1b2]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:43 devstack sudo[89818]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.470s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:43 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Deleted volume successfully. Apr 22 09:27:43 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 Apr 22 09:27:43 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e63a97a3-6533-4792-af54-08aa4f651179 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-9175f13a-3e83-48f0-8f2f-28290198457f-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:43 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_2o0rbsyx" returned: 0 in 0.512s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_2o0rbsyx {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:43 devstack sudo[89821]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.506s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:43 devstack sudo[89830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_2o0rbsyx Apr 22 09:27:43 devstack sudo[89830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:43 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Deleted volume successfully. Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-91da44e7-0177-43b3-9a66-8649db58e7f3 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-8b7e5f3d-99a2-4060-976d-6e18f8c3362a-delete_volume" released by "delete_volume" :: held 1.828s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:43 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021" returned: 0 in 0.504s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:43 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea 1G Apr 22 09:27:43 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "cinder-89c920a2-e288-4456-89a5-a33683e93afb-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-728cca08-7685-4217-aca6-b53049585449-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-89c920a2-e288-4456-89a5-a33683e93afb-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-728cca08-7685-4217-aca6-b53049585449-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-quobyte-728cca08-7685-4217-aca6-b53049585449" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "cinder-quobyte-89c920a2-e288-4456-89a5-a33683e93afb" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-728cca08-7685-4217-aca6-b53049585449" acquired by "delete_volume" :: waited 0.019s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-quobyte-89c920a2-e288-4456-89a5-a33683e93afb" acquired by "delete_volume" :: waited 0.017s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:43 devstack sudo[89830]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c336f9b-e79c-4e63-9742-a51b8e9bea11]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b96a4ef-d579-44d4-957e-8de556fa6213]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_2o0rbsyx" returned: 1 in 0.530s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_2o0rbsyx' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77c83a0-881b-4795-9945-959cefa2a476]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:43 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449 Apr 22 09:27:43 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:43 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD Apr 22 09:27:43 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:43 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb Apr 22 09:27:43 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:44 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea 1G" returned: 0 in 0.563s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:44 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea Apr 22 09:27:44 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:44 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD" returned: 0 in 0.471s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b was qcow2, converting to raw {{(pid=82642) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1126}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:44 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef Apr 22 09:27:44 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:44 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb" returned: 0 in 0.532s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:44 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449" returned: 0 in 0.566s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:44 devstack sudo[89861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb Apr 22 09:27:44 devstack sudo[89861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:44 devstack sudo[89862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449 Apr 22 09:27:44 devstack sudo[89862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:44 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea" returned: 0 in 0.443s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:44 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea is being set with open permissions: ugo+rw Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:44 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea Apr 22 09:27:44 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:44 devstack sudo[89861]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-89c920a2-e288-4456-89a5-a33683e93afb" returned: 0 in 0.489s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-quobyte-89c920a2-e288-4456-89a5-a33683e93afb" released by "delete_volume" :: held 1.051s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Created reservations ['87f5cce5-1b7d-414a-b009-14e0e7fe4da1', '8cade7d2-5959-4a4b-9109-c547e2a00e90', '51e59693-50c2-4aa1-b34c-5d201b210d1e', '3370eb32-fd01-40a4-a93a-c47554d17ecb'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:44 devstack sudo[89862]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-728cca08-7685-4217-aca6-b53049585449" returned: 0 in 0.554s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-728cca08-7685-4217-aca6-b53049585449" released by "delete_volume" :: held 1.166s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:45 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:45 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created reservations ['487bb978-2d12-4db6-bf39-d9560950f64e', '7a9caaee-faa8-4a83-8fb4-de1c780926a6', '89ce54a6-2707-4b53-89ea-445f3340ed3c', '66985ddb-eaa8-4ef3-b7f4-a605d5f6dbf3'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:45 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:45 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:45 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea" returned: 0 in 0.555s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:45 devstack sudo[89883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.info Apr 22 09:27:45 devstack sudo[89883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:45 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" returned: 0 in 0.927s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a0ecf83-2283-4bb2-804e-de9cf0d63a3b_rw0ul2zndevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:27:45 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Converted 112.00 MB image at 112.00 MB/s Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:45 devstack sudo[89885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef 1G Apr 22 09:27:45 devstack sudo[89885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:45 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.511s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:45 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Deleted volume successfully. Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a5f2ad98-ac18-45f4-859b-bf4ef0b3c276 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-89c920a2-e288-4456-89a5-a33683e93afb-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:45 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.436s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:45 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Deleted volume successfully. Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d0adad3-dd7d-4fbc-bf85-ca948c9b7246 tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-728cca08-7685-4217-aca6-b53049585449-delete_volume" released by "delete_volume" :: held 1.764s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:45 devstack sudo[89883]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.info" returned: 0 in 0.443s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:45 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.info is being set with open permissions: ugo+rw Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:45 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.info Apr 22 09:27:45 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:45 devstack sudo[89885]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef 1G" returned: 0 in 0.462s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4037371-81d9-47a5-8491-f786a06be88b]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:45 devstack sudo[89895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef Apr 22 09:27:45 devstack sudo[89895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-ed093095-5693-44c1-b917-fa77d0d8e2eb-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "cinder-9477ab2e-757f-47a6-b284-2a786e3ab21f-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-9477ab2e-757f-47a6-b284-2a786e3ab21f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-ed093095-5693-44c1-b917-fa77d0d8e2eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:45 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-quobyte-9605f3e7-eb92-44d2-8229-8d8a557b9232" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-9605f3e7-eb92-44d2-8229-8d8a557b9232" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-quobyte-ed093095-5693-44c1-b917-fa77d0d8e2eb" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-ed093095-5693-44c1-b917-fa77d0d8e2eb" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Deleting offline snapshot ed093095-5693-44c1-b917-fa77d0d8e2eb of volume 9605f3e7-eb92-44d2-8229-8d8a557b9232 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] snapshot_file for this snap is: volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "cinder-quobyte-9477ab2e-757f-47a6-b284-2a786e3ab21f" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c2beb6-10d6-41bc-9556-ae94b71fb16f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-quobyte-9477ab2e-757f-47a6-b284-2a786e3ab21f" acquired by "delete_volume" :: waited 0.019s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a510ffdc-0674-4e6b-b825-2a6725b38e20]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:46 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.info" returned: 0 in 0.436s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:46 devstack sudo[89898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb Apr 22 09:27:46 devstack sudo[89898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:46 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f Apr 22 09:27:46 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:46 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-84e39aa3-6c5a-40f3-b933-4f956577e4a8 tempest-VolumesSnapshotTestJSON-1069919655 None] Create snapshot completed successfully Apr 22 09:27:46 devstack sudo[89895]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" returned: 0 in 0.534s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:46 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef Apr 22 09:27:46 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:46 devstack sudo[89898]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb" returned: 0 in 0.497s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9605f3e7-eb92-44d2-8229-8d8a557b9232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[187a32cb-c04c-44b3-ac59-d2dfd1da6771]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:46 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f" returned: 0 in 0.499s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:46 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f Apr 22 09:27:46 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:46 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 Apr 22 09:27:46 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:46 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" returned: 1 in 0.495s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Downloaded image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b ((None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}])) to volume c22c592a-0c49-4588-bf64-dfdfa85eb3ef successfully. {{(pid=82642) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Temporary image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b for user 8e3daf2e258c4af9bcdeb09a5f02a003 is deleted. {{(pid=82642) fetch /opt/stack/cinder/cinder/image/image_utils.py:1443}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.volume.volume_utils [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Marking volume c22c592a-0c49-4588-bf64-dfdfa85eb3ef as bootable. {{(pid=82642) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Copying metadata from image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b to c22c592a-0c49-4588-bf64-dfdfa85eb3ef. {{(pid=82642) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Creating volume glance metadata for volume c22c592a-0c49-4588-bf64-dfdfa85eb3ef backed by image 0a0ecf83-2283-4bb2-804e-de9cf0d63a3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82642) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61687d98-e3aa-4592-b17e-a65a41c44cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef', 'volume_size': 1, 'image_id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '13cd308fc4eb4316be3ccae6d4feb336', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a0ecf83-2283-4bb2-804e-de9cf0d63a3b', 'created_at': datetime.datetime(2026, 4, 22, 7, 16, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 22, 7, 16, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a0ecf83-2283-4bb2-804e-de9cf0d63a3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fd1857-8857-4739-a099-a28b264a6f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:46 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Volume volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef (c22c592a-0c49-4588-bf64-dfdfa85eb3ef): created successfully Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3fd1857-8857-4739-a099-a28b264a6f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Flow 'volume_create_manager' (3c575f0a-469e-4d37-99a7-1beaaff2f755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:46 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-682773ce-990f-4b91-b6a5-f3972d665190 tempest-VolumesExtendTest-2069187675 None] Created volume successfully. Apr 22 09:27:46 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9477ab2e-757f-47a6-b284-2a786e3ab21f" returned: 0 in 0.429s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-quobyte-9477ab2e-757f-47a6-b284-2a786e3ab21f" released by "delete_volume" :: held 0.956s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Created reservations ['4a46f31f-7106-4f0c-869d-600e756f8cb9', 'fb19893e-4aca-4868-9c02-724e2517e977', 'a70438c8-aa87-4529-8530-212610c6cc2a', '47c7cf34-0bb6-4c16-b650-93c2608ba293'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:47 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232" returned: 0 in 0.520s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:47 devstack sudo[89924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb Apr 22 09:27:47 devstack sudo[89924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:47 devstack sudo[89926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:47 devstack sudo[89926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-47778fdb-736f-483b-a141-ff2480317bc8 tempest-VolumesExtendTest-2069187675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-47778fdb-736f-483b-a141-ff2480317bc8 tempest-VolumesExtendTest-2069187675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[525635a1-1d85-43bd-86c0-60544687afa7]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47778fdb-736f-483b-a141-ff2480317bc8 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:47 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef Apr 22 09:27:47 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-f22a016b-e568-40f5-bb6f-5211d6263cea-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:47 devstack sudo[89926]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-f22a016b-e568-40f5-bb6f-5211d6263cea-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.465s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:47 devstack sudo[89924]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:47 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Deleted volume successfully. Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb" returned: 0 in 0.528s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:47 devstack sudo[89934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb Apr 22 09:27:47 devstack sudo[89934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-12a79534-5233-45d7-aedc-82ab08e85a9d tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-9477ab2e-757f-47a6-b284-2a786e3ab21f-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-312ff1a2-3c45-4b1d-bbe4-69c4495b4021" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-312ff1a2-3c45-4b1d-bbe4-69c4495b4021" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-f22a016b-e568-40f5-bb6f-5211d6263cea" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-f22a016b-e568-40f5-bb6f-5211d6263cea" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Deleting offline snapshot f22a016b-e568-40f5-bb6f-5211d6263cea of volume 312ff1a2-3c45-4b1d-bbe4-69c4495b4021 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] snapshot_file for this snap is: volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d2f702-f5f4-4e96-b23e-cad8502c1fb5]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:47 devstack sudo[89936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea Apr 22 09:27:47 devstack sudo[89936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:47 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47778fdb-736f-483b-a141-ff2480317bc8 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" returned: 0 in 0.599s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47778fdb-736f-483b-a141-ff2480317bc8 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:48 devstack sudo[89934]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232.ed093095-5693-44c1-b917-fa77d0d8e2eb" returned: 0 in 0.427s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-ed093095-5693-44c1-b917-fa77d0d8e2eb" released by "_delete_snapshot" :: held 2.039s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-9605f3e7-eb92-44d2-8229-8d8a557b9232" released by "delete_snapshot" :: held 2.059s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:48 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef Apr 22 09:27:48 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created reservations ['538573a4-2905-4e14-85b1-a77c85f6503f', 'a287ba21-c7f8-4219-a7e8-2c771c2e8861', '13161471-4290-4929-9795-dac6497b0a5f', '48994b00-140b-4fe9-9c7e-622a87bb4780'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:48 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Delete snapshot completed successfully. Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-274778fb-3ba4-4b95-aac2-35edf28dff7c tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-ed093095-5693-44c1-b917-fa77d0d8e2eb-delete_snapshot" released by "delete_snapshot" :: held 2.166s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "cinder-92dec04f-1dd9-4b80-9931-f68b8ec8165b-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-92dec04f-1dd9-4b80-9931-f68b8ec8165b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:48 devstack sudo[89936]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea" returned: 0 in 0.525s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "cinder-quobyte-92dec04f-1dd9-4b80-9931-f68b8ec8165b" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bdacf6c-896c-4a82-aebe-4183aa808eab]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-quobyte-92dec04f-1dd9-4b80-9931-f68b8ec8165b" acquired by "delete_volume" :: waited 0.020s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2feeab1-719f-44a9-89d8-8493d2903d33]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:48 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 Apr 22 09:27:48 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:48 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b Apr 22 09:27:48 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:48 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47778fdb-736f-483b-a141-ff2480317bc8 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" returned: 1 in 0.526s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47778fdb-736f-483b-a141-ff2480317bc8 tempest-VolumesExtendTest-2069187675 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47778fdb-736f-483b-a141-ff2480317bc8 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef 2G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-47778fdb-736f-483b-a141-ff2480317bc8 tempest-VolumesExtendTest-2069187675 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef 2G" returned: 0 in 0.045s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-47778fdb-736f-483b-a141-ff2480317bc8 tempest-VolumesExtendTest-2069187675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.214s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:48 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-47778fdb-736f-483b-a141-ff2480317bc8 tempest-VolumesExtendTest-2069187675 None] Extend volume completed successfully. Apr 22 09:27:48 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021" returned: 0 in 0.499s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:48 devstack sudo[89962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea Apr 22 09:27:48 devstack sudo[89962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:48 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:48 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b Apr 22 09:27:48 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-9605f3e7-eb92-44d2-8229-8d8a557b9232-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-9605f3e7-eb92-44d2-8229-8d8a557b9232-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "cinder-quobyte-9605f3e7-eb92-44d2-8229-8d8a557b9232" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-9605f3e7-eb92-44d2-8229-8d8a557b9232" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ace4a3-cc6b-4b6e-8bc0-c0f1e3568a3b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:49 devstack sudo[89962]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:49 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 Apr 22 09:27:49 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:49 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea Apr 22 09:27:49 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:49 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-92dec04f-1dd9-4b80-9931-f68b8ec8165b" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-quobyte-92dec04f-1dd9-4b80-9931-f68b8ec8165b" released by "delete_volume" :: held 1.067s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Created reservations ['9d912050-02cd-4415-9202-0e2b72bf7f6f', '071760d8-3bff-4269-9532-379729ac5d42', 'de8481e3-069e-47dd-9f7d-691af85a803b', '4f164fe1-1177-4917-b797-2b51ed91cda6'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:49 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:49 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Acquiring lock "cinder-c22c592a-0c49-4588-bf64-dfdfa85eb3ef-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Lock "cinder-c22c592a-0c49-4588-bf64-dfdfa85eb3ef-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:49 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232" returned: 0 in 0.527s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Acquiring lock "cinder-quobyte-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Lock "cinder-quobyte-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:49 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232 Apr 22 09:27:49 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a402941-ca6b-4858-8634-675dc3f57bf5]: (4, 'raw') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:49 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021.f22a016b-e568-40f5-bb6f-5211d6263cea" returned: 0 in 0.549s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-f22a016b-e568-40f5-bb6f-5211d6263cea" released by "_delete_snapshot" :: held 2.161s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-312ff1a2-3c45-4b1d-bbe4-69c4495b4021" released by "delete_snapshot" :: held 2.172s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Created reservations ['f9087248-a88f-4c03-9622-e72e722aca57', 'ff59e3cc-519d-489f-ac47-9c7dd2f683f9', 'a03968f4-7feb-43ff-aaba-04276aa10ac1', '2aba5903-be65-4937-bdd0-57b4f1fe812f'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:49 devstack sudo[89983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef Apr 22 09:27:49 devstack sudo[89983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:49 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.500s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:49 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Deleted volume successfully. Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb96a40d-318d-439a-bf17-330f41aa6a86 tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-92dec04f-1dd9-4b80-9931-f68b8ec8165b-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:49 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Delete snapshot completed successfully. Apr 22 09:27:49 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ec905ebf-f9bc-42e9-b428-1b3fb19b5f36 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-f22a016b-e568-40f5-bb6f-5211d6263cea-delete_snapshot" released by "delete_snapshot" :: held 2.339s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:50 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9605f3e7-eb92-44d2-8229-8d8a557b9232" returned: 0 in 0.495s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-quobyte-9605f3e7-eb92-44d2-8229-8d8a557b9232" released by "delete_volume" :: held 1.060s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Created reservations ['44bac03e-4373-4e2c-997a-9136ef9d8727', 'f0f8ccc2-f7f2-4b52-8628-e8c16dd3e143', 'e75656cb-f114-47d4-a78b-aa85afd80ae5', 'd6a7422c-b9a6-45c1-9f89-d832cadce0c8'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:50 devstack sudo[89983]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" returned: 0 in 0.538s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:50 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:50 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "cinder-76d61acd-55d8-426d-aae1-e13cea92f888-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-76d61acd-55d8-426d-aae1-e13cea92f888-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:50 devstack sudo[89990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef Apr 22 09:27:50 devstack sudo[89990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "cinder-quobyte-76d61acd-55d8-426d-aae1-e13cea92f888" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-quobyte-76d61acd-55d8-426d-aae1-e13cea92f888" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[534c1b49-8190-445d-aa8b-a5f4b4b4f4f5]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:50 devstack sudo[89992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888 Apr 22 09:27:50 devstack sudo[89992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:50 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.433s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:50 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Deleted volume successfully. Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-88a4f4c7-8cf8-4543-bbef-9f564cca132d tempest-CreateVolumesFromSnapshotTest-1651101231 None] Lock "cinder-9605f3e7-eb92-44d2-8229-8d8a557b9232-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:50 devstack sudo[89990]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" returned: 1 in 0.503s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef' failed. Not Retrying. {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 22 09:27:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:50 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef Apr 22 09:27:50 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:51 devstack sudo[89992]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Flow 'volume_create_manager' (c158cc2f-eb8c-4583-8aa3-8e519ec5b734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60e1126-beb7-4fa6-89fa-b69645013961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c60e1126-beb7-4fa6-89fa-b69645013961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1007405402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac2ec37-c81a-45a7-964a-86b9f85e1bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac53dce68b2b436c935975967f1d6cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:51Z,use_quota=True,user_id='22ac19ce029a4f78a12783eeec115956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5b492c-d41e-4315-9651-237391b2bf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f5b492c-d41e-4315-9651-237391b2bf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199a94e6-c745-4275-ae64-0a061f28c62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (199a94e6-c745-4275-ae64-0a061f28c62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ac2ec37-c81a-45a7-964a-86b9f85e1bc8', 'volume_name': 'volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29dabafd-9222-4945-887a-9b42299226c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29dabafd-9222-4945-887a-9b42299226c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9252e454-8ee6-4330-b054-6ee7894de9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:51 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume 9ac2ec37-c81a-45a7-964a-86b9f85e1bc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8', 'volume_size': 1} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1007405402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac2ec37-c81a-45a7-964a-86b9f85e1bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac53dce68b2b436c935975967f1d6cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:51Z,use_quota=True,user_id='22ac19ce029a4f78a12783eeec115956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Creating volume 9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:51 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888" returned: 0 in 0.642s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:51 devstack sudo[90003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 1073741824 Apr 22 09:27:51 devstack sudo[90003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:51 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888 Apr 22 09:27:51 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:51 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" returned: 0 in 0.437s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Lock "cinder-quobyte-c22c592a-0c49-4588-bf64-dfdfa85eb3ef" released by "delete_volume" :: held 1.519s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Created reservations ['c2434e42-2598-4513-bfe8-4d1e999720c1', '80b4ede9-8947-4a1b-a7f5-5a712275eda9', '7d3f6fdd-95d4-4d4e-8746-6f966058ae02', '7e1d2e48-4c84-40d2-8c2c-6615318ab9c9'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:51 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:51 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:51 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-76d61acd-55d8-426d-aae1-e13cea92f888" returned: 0 in 0.500s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-quobyte-76d61acd-55d8-426d-aae1-e13cea92f888" released by "delete_volume" :: held 1.165s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:51 devstack sudo[90003]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 1073741824" returned: 0 in 0.535s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Created reservations ['f729c217-e3ca-4f11-b419-7756be3ae842', '88fb2ec3-61c6-4606-ae0d-caeb9d2fc816', 'a181f871-f180-4f0b-a393-1285e9765d86', '7dc15bc1-851a-4330-8303-fd2f580f1998'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:27:51 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 Apr 22 09:27:51 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:51 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:27:51 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:51 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.507s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:51 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Deleted volume successfully. Apr 22 09:27:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d496a727-10db-4eb9-8d59-cdaa65dcd86a tempest-VolumesExtendTest-2069187675 None] Lock "cinder-c22c592a-0c49-4588-bf64-dfdfa85eb3ef-delete_volume" released by "delete_volume" :: held 2.209s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Flow 'volume_create_manager' (36b7cb58-cace-4e27-8a46-0d0acb9a314a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60359a40-4ed0-4485-bef6-42382b1caaeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:52 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" returned: 0 in 0.554s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60359a40-4ed0-4485-bef6-42382b1caaeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1581619220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a904f80-f4cd-496a-9c52-4dd2ca40dce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bfdb38f1304361a07b92d85564e316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:52Z,use_quota=True,user_id='8e3daf2e258c4af9bcdeb09a5f02a003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99cd3e65-b412-4903-86eb-848462c6b69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99cd3e65-b412-4903-86eb-848462c6b69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b968977-99af-478f-9de3-f0007862b556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b968977-99af-478f-9de3-f0007862b556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a904f80-f4cd-496a-9c52-4dd2ca40dce1', 'volume_name': 'volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7c366f-2fd8-4be7-82a0-68f8c38e3060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f7c366f-2fd8-4be7-82a0-68f8c38e3060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26f1472-af81-4490-9e81-b5d1d7088490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:52 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Volume 3a904f80-f4cd-496a-9c52-4dd2ca40dce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1', 'volume_size': 1} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1581619220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a904f80-f4cd-496a-9c52-4dd2ca40dce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8bfdb38f1304361a07b92d85564e316',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:52Z,use_quota=True,user_id='8e3daf2e258c4af9bcdeb09a5f02a003',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Creating volume 3a904f80-f4cd-496a-9c52-4dd2ca40dce1 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:52 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9252e454-8ee6-4330-b054-6ee7894de9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1269c275-60fe-4de6-859e-5279aefe2006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:52 devstack sudo[90022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 1073741824 Apr 22 09:27:52 devstack sudo[90022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:52 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 (9ac2ec37-c81a-45a7-964a-86b9f85e1bc8): created successfully Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1269c275-60fe-4de6-859e-5279aefe2006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Flow 'volume_create_manager' (c158cc2f-eb8c-4583-8aa3-8e519ec5b734) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:52 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:52 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-29e73c9e-83bb-4702-84b9-dcca9d79d2d0 tempest-VolumesSnapshotTestJSON-1069919655 None] Created volume successfully. Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.594s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:27:52 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Deleted volume successfully. Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-cb498cf7-6590-4d0d-9a0f-9ea77688e10a tempest-CreateVolumesFromImageTest-1560799293 None] Lock "cinder-76d61acd-55d8-426d-aae1-e13cea92f888-delete_volume" released by "delete_volume" :: held 1.970s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:27:52 devstack sudo[90022]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 1073741824" returned: 0 in 0.540s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:52 devstack sudo[90027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 Apr 22 09:27:52 devstack sudo[90027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:53 devstack sudo[90027]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" returned: 0 in 0.510s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b26f1472-af81-4490-9e81-b5d1d7088490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64420e3f-0a08-4bac-83d1-f5eecc554cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:53 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Volume volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 (3a904f80-f4cd-496a-9c52-4dd2ca40dce1): created successfully Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64420e3f-0a08-4bac-83d1-f5eecc554cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Flow 'volume_create_manager' (36b7cb58-cace-4e27-8a46-0d0acb9a314a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:53 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4685cca3-c1f4-47c4-bae7-8b8568464ddb tempest-VolumesExtendTest-2069187675 None] Created volume successfully. Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] Creating offline snapshot dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 of volume 9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eab87ad-79ba-415e-99e6-6b10c323807f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (61f926f8-a8a0-48bf-b8fe-d8fb02c1386c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78938211-3c69-4e29-a036-926f529e4b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:53 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 Apr 22 09:27:53 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78938211-3c69-4e29-a036-926f529e4b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1782585695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9502321-3a1b-4e90-a392-114b14b20cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:53Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d54ddcc-6203-4f04-a93a-ecfc6cc5fed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d54ddcc-6203-4f04-a93a-ecfc6cc5fed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82299845-a39d-468d-990b-bee4881def81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82299845-a39d-468d-990b-bee4881def81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9502321-3a1b-4e90-a392-114b14b20cc6', 'volume_name': 'volume-e9502321-3a1b-4e90-a392-114b14b20cc6', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c8cf62-e1e8-41dd-8293-5eaaa5cf378e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c8cf62-e1e8-41dd-8293-5eaaa5cf378e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b94bbb-269e-41d7-aa30-370c0d093ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:53 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume e9502321-3a1b-4e90-a392-114b14b20cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9502321-3a1b-4e90-a392-114b14b20cc6', 'volume_size': 1} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:53 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" returned: 0 in 0.549s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:54 devstack sudo[90035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 1G Apr 22 09:27:54 devstack sudo[90035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:54 devstack sudo[90035]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 1G" returned: 0 in 0.501s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:54 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 Apr 22 09:27:54 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:54 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6" returned: 0 in 0.440s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:54 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 is being set with open permissions: ugo+rw Apr 22 09:27:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:54 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 Apr 22 09:27:54 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:55 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6" returned: 0 in 0.441s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:55 devstack sudo[90048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.info Apr 22 09:27:55 devstack sudo[90048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:55 devstack sudo[90048]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.info" returned: 0 in 0.401s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:55 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.info is being set with open permissions: ugo+rw Apr 22 09:27:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:55 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.info Apr 22 09:27:55 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:56 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.info" returned: 0 in 0.397s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.799s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.621s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1782585695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9502321-3a1b-4e90-a392-114b14b20cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:53Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Creating volume e9502321-3a1b-4e90-a392-114b14b20cc6 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:27:56 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:56 devstack sudo[90054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6 1073741824 Apr 22 09:27:56 devstack sudo[90054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:56 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-bc7d2006-97be-486f-9106-5d447ec4ac7b tempest-VolumesSnapshotTestJSON-1069919655 None] Create snapshot completed successfully Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:56 devstack sudo[90054]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Flow 'volume_create_manager' (370217a5-9f11-4912-a1a2-00e822f12753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06595597-af75-4083-9c21-4444b1596375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6 1073741824" returned: 0 in 0.565s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06595597-af75-4083-9c21-4444b1596375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1618180320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da98f46e-4db7-43fa-94a7-d6d7d7ba5f53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac53dce68b2b436c935975967f1d6cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=dbbd86f5-d4bd-4c36-896f-be1378e7e6a6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:57Z,use_quota=True,user_id='22ac19ce029a4f78a12783eeec115956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8396209e-a94b-4bd5-97fa-60f27ca56b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8396209e-a94b-4bd5-97fa-60f27ca56b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69accfb2-28bb-4aad-9be8-b0f7aa3cd149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69accfb2-28bb-4aad-9be8-b0f7aa3cd149) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'da98f46e-4db7-43fa-94a7-d6d7d7ba5f53', 'volume_name': 'volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53', 'volume_size': 2, 'snapshot_id': 'dbbd86f5-d4bd-4c36-896f-be1378e7e6a6'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c73b790-541f-4095-90dd-1b3f63acc747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c73b790-541f-4095-90dd-1b3f63acc747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859a3600-cd4e-477a-b951-004cfdba4412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:56 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume da98f46e-4db7-43fa-94a7-d6d7d7ba5f53: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53', 'volume_size': 2, 'snapshot_id': 'dbbd86f5-d4bd-4c36-896f-be1378e7e6a6'} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:56 devstack sudo[90059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6 Apr 22 09:27:56 devstack sudo[90059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:57 devstack sudo[90059]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6" returned: 0 in 0.396s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.821s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] Creating offline snapshot 4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 of volume 3a904f80-f4cd-496a-9c52-4dd2ca40dce1 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b94bbb-269e-41d7-aa30-370c0d093ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9502321-3a1b-4e90-a392-114b14b20cc6', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bea0a3-b68b-4152-b3d0-a56d46bd4d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3224530d-dc64-422f-b2b1-e186bd1b6d57]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:57 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume volume-e9502321-3a1b-4e90-a392-114b14b20cc6 (e9502321-3a1b-4e90-a392-114b14b20cc6): created successfully Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7bea0a3-b68b-4152-b3d0-a56d46bd4d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (61f926f8-a8a0-48bf-b8fe-d8fb02c1386c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:57 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6c4700e1-f35f-493d-861f-552f85b25164 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created volume successfully. Apr 22 09:27:57 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 Apr 22 09:27:57 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:57 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" returned: 0 in 0.460s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:57 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 1G Apr 22 09:27:57 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (4a593f82-85d2-47ee-95a1-1f3f3497ae5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b621910a-60b2-4c1f-ad0f-9298e65af517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b621910a-60b2-4c1f-ad0f-9298e65af517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-350446545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3374a48b-dafc-4cc1-9e02-bd6f1cf43377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:58Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:57 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f39fdf9-d028-45c0-8f8a-92f64c6f224f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f39fdf9-d028-45c0-8f8a-92f64c6f224f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91df114-61df-4b4a-ad9c-bddd1b296601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d91df114-61df-4b4a-ad9c-bddd1b296601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3374a48b-dafc-4cc1-9e02-bd6f1cf43377', 'volume_name': 'volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63955b0c-1218-42f8-8689-c4590a41f449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63955b0c-1218-42f8-8689-c4590a41f449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c1bc3f-ce83-4d6c-9547-31f6d10c74f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume 3374a48b-dafc-4cc1-9e02-bd6f1cf43377: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377', 'volume_size': 1} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (522b5c90-290d-41b3-963a-8b32c36fb896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d28819-bdb8-46d3-826e-2552ba5be338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19d28819-bdb8-46d3-826e-2552ba5be338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-654176021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec88d671-487e-4051-9912-290ed47f0e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:58Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa6d2f1-3f95-4045-b981-dfcf50c58807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa6d2f1-3f95-4045-b981-dfcf50c58807) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e262f27b-8417-4d96-8cbe-6042e9393725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e262f27b-8417-4d96-8cbe-6042e9393725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec88d671-487e-4051-9912-290ed47f0e7d', 'volume_name': 'volume-ec88d671-487e-4051-9912-290ed47f0e7d', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5625dfa2-51f3-4e48-853b-b0033fd83448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5625dfa2-51f3-4e48-853b-b0033fd83448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1e7422-da3f-4858-9438-74598facc4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume ec88d671-487e-4051-9912-290ed47f0e7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec88d671-487e-4051-9912-290ed47f0e7d', 'volume_size': 1} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 1G" returned: 0 in 0.555s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:58 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 Apr 22 09:27:58 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (35acda47-241c-4aef-939a-30f0e1894630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73159739-0547-4bf2-9dee-09f57add425c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73159739-0547-4bf2-9dee-09f57add425c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1787853102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fcd578-05ad-4eba-80f4-c5f83db4b7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:58Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ef116d-bc42-4a39-a916-e6274ad073ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52ef116d-bc42-4a39-a916-e6274ad073ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac246ec8-90c2-4dc7-9fd7-6cd38bd6e799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac246ec8-90c2-4dc7-9fd7-6cd38bd6e799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1fcd578-05ad-4eba-80f4-c5f83db4b7d6', 'volume_name': 'volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688ba65c-448f-422d-9588-033ec4d14138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (688ba65c-448f-422d-9588-033ec4d14138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d348dfc5-bfa8-41b7-b9ec-896b1e1966c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume d1fcd578-05ad-4eba-80f4-c5f83db4b7d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6', 'volume_size': 1} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (f580ba76-fc05-4623-8499-8d0ae70196f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3e3c1f-06e7-4389-bec2-075bbd2dbebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce3e3c1f-06e7-4389-bec2-075bbd2dbebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37004061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0222591-28e4-44c4-96a7-7114b2d36155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:59Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f39ba1e-0d02-49ec-b3d2-17e26fd2e6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f39ba1e-0d02-49ec-b3d2-17e26fd2e6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85d1afd-67b4-4090-8443-861e2a7ce46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d85d1afd-67b4-4090-8443-861e2a7ce46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0222591-28e4-44c4-96a7-7114b2d36155', 'volume_name': 'volume-e0222591-28e4-44c4-96a7-7114b2d36155', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36d6c28-a13c-49f7-892d-aadd2af6ba33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d36d6c28-a13c-49f7-892d-aadd2af6ba33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c4598a-8478-4ed6-b31a-0c125d9578c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume e0222591-28e4-44c4-96a7-7114b2d36155: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0222591-28e4-44c4-96a7-7114b2d36155', 'volume_size': 1} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (67541ac0-3fc4-41ab-b194-126760822868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea4307a-5ef0-4b28-a57a-1c5b17e3db2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aea4307a-5ef0-4b28-a57a-1c5b17e3db2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935106203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26a344d-854a-4ccd-afa1-4de0db10db18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:59Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f879628-33b7-40f4-9955-442b2e5a8fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f879628-33b7-40f4-9955-442b2e5a8fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbaa7cb-6a22-4909-8f34-871d065451e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cbaa7cb-6a22-4909-8f34-871d065451e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b26a344d-854a-4ccd-afa1-4de0db10db18', 'volume_name': 'volume-b26a344d-854a-4ccd-afa1-4de0db10db18', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2143a985-41f8-4fcf-90c6-68403b7b0116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2143a985-41f8-4fcf-90c6-68403b7b0116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fcf196-3f0d-4812-9492-6e585997a527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:27:58 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume b26a344d-854a-4ccd-afa1-4de0db10db18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b26a344d-854a-4ccd-afa1-4de0db10db18', 'volume_size': 1} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89" returned: 0 in 0.522s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:58 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 is being set with open permissions: ugo+rw Apr 22 09:27:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:58 devstack sudo[90077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 Apr 22 09:27:58 devstack sudo[90077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:59 devstack sudo[90077]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89" returned: 0 in 0.419s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:59 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.info Apr 22 09:27:59 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:27:59 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 22 09:27:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.info" returned: 0 in 0.393s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:27:59 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.info is being set with open permissions: ugo+rw Apr 22 09:27:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:27:59 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.info Apr 22 09:27:59 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:00 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.info" returned: 0 in 0.447s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.854s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.273s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-dbbd86f5-d4bd-4c36-896f-be1378e7e6a6-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" by "_create_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:00 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-920290ec-a66a-4b61-b699-237a657d8afe tempest-VolumesExtendTest-2069187675 None] Create snapshot completed successfully Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-dbbd86f5-d4bd-4c36-896f-be1378e7e6a6-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Creating volume da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 from snapshot dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 {{(pid=82642) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] snapshot: dbbd86f5-d4bd-4c36-896f-be1378e7e6a6, volume: da98f46e-4db7-43fa-94a7-d6d7d7ba5f53, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18e6810-4f4a-4520-ab84-520012746061]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:00 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 Apr 22 09:28:00 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:00 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6" returned: 0 in 0.457s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0345c1f4-baa8-4fd7-89b9-1554a8f34e54]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ef282a22-2369-4fe8-9d24-7b21ba4721b1 tempest-VolumesExtendTest-2069187675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:00 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 Apr 22 09:28:00 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:01 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" returned: 0 in 0.531s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:01 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:28:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:01 devstack sudo[90097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 Apr 22 09:28:01 devstack sudo[90097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:03 devstack sudo[90097]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" returned: 0 in 2.014s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:03 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d52c11-0b8c-4065-a91a-03c63d0ede7c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:03 devstack sudo[90109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 Apr 22 09:28:03 devstack sudo[90109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:03 devstack sudo[90109]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" returned: 0 in 0.619s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:03 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8, size 1024.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:28:03 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Converted 1024.00 MB image at 508.09 MB/s Apr 22 09:28:03 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 is being set with open permissions: ugo+rw Apr 22 09:28:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:03 devstack sudo[90114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 Apr 22 09:28:03 devstack sudo[90114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:04 devstack sudo[90114]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" returned: 0 in 0.470s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" released by "_copy_volume_from_snapshot" :: held 4.148s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-dbbd86f5-d4bd-4c36-896f-be1378e7e6a6-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" released by "_create_volume_from_snapshot" :: held 4.167s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.192s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.272s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-350446545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3374a48b-dafc-4cc1-9e02-bd6f1cf43377,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:58Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Creating volume 3374a48b-dafc-4cc1-9e02-bd6f1cf43377 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:04 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:04 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377 1073741824 Apr 22 09:28:04 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (859a3600-cd4e-477a-b951-004cfdba4412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53', 'volume_size': 2, 'snapshot_id': 'dbbd86f5-d4bd-4c36-896f-be1378e7e6a6'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d71b4f-c95a-4ee2-9001-3ddd437f1a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:04 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 (da98f46e-4db7-43fa-94a7-d6d7d7ba5f53): created successfully Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d71b4f-c95a-4ee2-9001-3ddd437f1a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Flow 'volume_create_manager' (370217a5-9f11-4912-a1a2-00e822f12753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:04 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4a436bb6-561b-4182-984d-0c91a961edb4 tempest-VolumesSnapshotTestJSON-1069919655 None] Created volume successfully. Apr 22 09:28:04 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377 1073741824" returned: 0 in 0.468s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:04 devstack sudo[90122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377 Apr 22 09:28:04 devstack sudo[90122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:05 devstack sudo[90122]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377" returned: 0 in 0.434s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.948s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-654176021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec88d671-487e-4051-9912-290ed47f0e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:58Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Creating volume ec88d671-487e-4051-9912-290ed47f0e7d {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:05 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c1bc3f-ce83-4d6c-9547-31f6d10c74f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f8e510-d417-4ce0-aaaf-65eb20540b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:05 devstack sudo[90125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d 1073741824 Apr 22 09:28:05 devstack sudo[90125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:05 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377 (3374a48b-dafc-4cc1-9e02-bd6f1cf43377): created successfully Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f8e510-d417-4ce0-aaaf-65eb20540b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (4a593f82-85d2-47ee-95a1-1f3f3497ae5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:05 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-3cff8dd5-ac69-4c3e-899e-1ab53bf5ccde tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created volume successfully. Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa88939b-3cb8-4111-a5bf-a1e8f5bb8401]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:05 devstack sudo[90127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 Apr 22 09:28:05 devstack sudo[90127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:05 devstack sudo[90125]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d 1073741824" returned: 0 in 0.511s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:05 devstack sudo[90132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d Apr 22 09:28:05 devstack sudo[90132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:05 devstack sudo[90127]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" returned: 0 in 0.500s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:05 devstack sudo[90137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53 Apr 22 09:28:05 devstack sudo[90137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:06 devstack sudo[90132]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d" returned: 0 in 0.443s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.790s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1787853102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1fcd578-05ad-4eba-80f4-c5f83db4b7d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:58Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Creating volume d1fcd578-05ad-4eba-80f4-c5f83db4b7d6 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:06 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:06 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6 1073741824 Apr 22 09:28:06 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1e7422-da3f-4858-9438-74598facc4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec88d671-487e-4051-9912-290ed47f0e7d', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991e83e9-069e-4f3a-9f60-a8f712e7121a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:06 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume volume-ec88d671-487e-4051-9912-290ed47f0e7d (ec88d671-487e-4051-9912-290ed47f0e7d): created successfully Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (991e83e9-069e-4f3a-9f60-a8f712e7121a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (522b5c90-290d-41b3-963a-8b32c36fb896) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:06 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-608a5d71-516f-4040-95c7-00421b9ad92e tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created volume successfully. Apr 22 09:28:06 devstack sudo[90137]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" returned: 0 in 0.445s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53" released by "delete_volume" :: held 0.969s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Created reservations ['8c98c77f-4305-45ce-98a6-7b1c12d6d3eb', 'ad9489cd-bdd2-4dda-8dd4-5f8938936e4c', '4d6fe899-abc6-4b17-a3bc-1bf9c3d86aa5', 'b650af88-d133-4a08-8e82-5cc7eaf750e7'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:06 devstack sudo[90143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:06 devstack sudo[90143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-dbbd86f5-d4bd-4c36-896f-be1378e7e6a6-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-dbbd86f5-d4bd-4c36-896f-be1378e7e6a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-dbbd86f5-d4bd-4c36-896f-be1378e7e6a6" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-dbbd86f5-d4bd-4c36-896f-be1378e7e6a6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Deleting offline snapshot dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 of volume 9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] snapshot_file for this snap is: volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b097eba-bdef-4c5c-81dc-153f84ec71b8]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:06 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 Apr 22 09:28:06 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:06 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6 1073741824" returned: 0 in 0.547s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:06 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6 Apr 22 09:28:06 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:06 devstack sudo[90143]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.484s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:06 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Deleted volume successfully. Apr 22 09:28:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7856e713-c122-4f10-83d2-d72800d7bc18 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-da98f46e-4db7-43fa-94a7-d6d7d7ba5f53-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:07 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6" returned: 0 in 0.523s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8899765-0a18-42e2-a455-82481a33b87b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:07 devstack sudo[90156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 Apr 22 09:28:07 devstack sudo[90156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:07 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6" returned: 0 in 0.434s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.605s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-37004061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0222591-28e4-44c4-96a7-7114b2d36155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:59Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Creating volume e0222591-28e4-44c4-96a7-7114b2d36155 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:07 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:07 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155 1073741824 Apr 22 09:28:07 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d348dfc5-bfa8-41b7-b9ec-896b1e1966c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8484d265-027c-40ad-bf98-a6a987831784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:07 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6 (d1fcd578-05ad-4eba-80f4-c5f83db4b7d6): created successfully Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8484d265-027c-40ad-bf98-a6a987831784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (35acda47-241c-4aef-939a-30f0e1894630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:07 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-768d1d86-6d86-48a4-a9cf-5eb66b1c688a tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created volume successfully. Apr 22 09:28:07 devstack sudo[90156]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" returned: 0 in 0.483s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:07 devstack sudo[90166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 Apr 22 09:28:07 devstack sudo[90166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:07 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155 1073741824" returned: 0 in 0.506s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:07 devstack sudo[90169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155 Apr 22 09:28:07 devstack sudo[90169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:08 devstack sudo[90166]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6" returned: 0 in 0.456s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:08 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6 Apr 22 09:28:08 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:08 devstack sudo[90169]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155" returned: 0 in 0.472s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.446s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:27:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-935106203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b26a344d-854a-4ccd-afa1-4de0db10db18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d011cdcd2a745b380859513269ffd14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:27:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:27:59Z,use_quota=True,user_id='97ddefa49b3f405ab79fa7c55cb7329e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Creating volume b26a344d-854a-4ccd-afa1-4de0db10db18 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:08 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c4598a-8478-4ed6-b31a-0c125d9578c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0222591-28e4-44c4-96a7-7114b2d36155', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:08 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18 1073741824 Apr 22 09:28:08 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccad5802-0643-4280-b195-9aa7e924962f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:08 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume volume-e0222591-28e4-44c4-96a7-7114b2d36155 (e0222591-28e4-44c4-96a7-7114b2d36155): created successfully Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccad5802-0643-4280-b195-9aa7e924962f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (f580ba76-fc05-4623-8499-8d0ae70196f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:08 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-04ce9d2f-caca-4ec3-a61b-e84e437e42b1 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created volume successfully. Apr 22 09:28:08 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8.dbbd86f5-d4bd-4c36-896f-be1378e7e6a6" returned: 0 in 0.458s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-dbbd86f5-d4bd-4c36-896f-be1378e7e6a6" released by "_delete_snapshot" :: held 1.980s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" released by "delete_snapshot" :: held 1.992s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Created reservations ['0506337b-3350-4bf4-9f1a-f1814ffb7ae8', 'cce37022-e222-47c2-846f-b94be477daeb', '3c43c876-e7c0-4e4a-a167-3aff69db39e8', '663cd0a3-6d60-4813-b0ad-f805a4da0fc7'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:08 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Delete snapshot completed successfully. Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2be5df70-cff0-47f1-b9cf-188fbe1ac1f6 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-dbbd86f5-d4bd-4c36-896f-be1378e7e6a6-delete_snapshot" released by "delete_snapshot" :: held 2.090s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:08 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18 1073741824" returned: 0 in 0.503s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:08 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18 Apr 22 09:28:08 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:09 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18" returned: 0 in 0.434s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ef282a22-2369-4fe8-9d24-7b21ba4721b1 tempest-VolumesExtendTest-2069187675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 8.506s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59fcf196-3f0d-4812-9492-6e585997a527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b26a344d-854a-4ccd-afa1-4de0db10db18', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fe67b5-a7f8-42de-aa5b-45904feffc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a033859-009d-499f-a6aa-97f330a05df6]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ef282a22-2369-4fe8-9d24-7b21ba4721b1 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:09 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Volume volume-b26a344d-854a-4ccd-afa1-4de0db10db18 (b26a344d-854a-4ccd-afa1-4de0db10db18): created successfully Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fe67b5-a7f8-42de-aa5b-45904feffc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Flow 'volume_create_manager' (67541ac0-3fc4-41ab-b194-126760822868) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:09 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0dcd8769-38de-49a1-b099-a19ea280ab0c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created volume successfully. Apr 22 09:28:09 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 Apr 22 09:28:09 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-b26a344d-854a-4ccd-afa1-4de0db10db18-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-b26a344d-854a-4ccd-afa1-4de0db10db18-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-quobyte-b26a344d-854a-4ccd-afa1-4de0db10db18" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-b26a344d-854a-4ccd-afa1-4de0db10db18" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05ff4b5-6e6d-42bd-b0d7-9ccfd5770669]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:09 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18 Apr 22 09:28:09 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:09 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ef282a22-2369-4fe8-9d24-7b21ba4721b1 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" returned: 0 in 0.577s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ef282a22-2369-4fe8-9d24-7b21ba4721b1 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 2G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6621924-9339-4dd5-a22a-62fa1c3c2a1f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ef282a22-2369-4fe8-9d24-7b21ba4721b1 tempest-VolumesExtendTest-2069187675 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 2G" returned: 0 in 0.069s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ef282a22-2369-4fe8-9d24-7b21ba4721b1 tempest-VolumesExtendTest-2069187675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.668s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:09 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 Apr 22 09:28:09 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:09 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ef282a22-2369-4fe8-9d24-7b21ba4721b1 tempest-VolumesExtendTest-2069187675 None] Extend volume completed successfully. Apr 22 09:28:10 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18" returned: 0 in 0.483s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:10 devstack sudo[90201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18 Apr 22 09:28:10 devstack sudo[90201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Acquiring lock "cinder-4e59eaec-1c7a-4fb7-a4e9-84694f0ada89-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Lock "cinder-4e59eaec-1c7a-4fb7-a4e9-84694f0ada89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Acquiring lock "cinder-quobyte-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Lock "cinder-quobyte-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Acquiring lock "cinder-quobyte-4e59eaec-1c7a-4fb7-a4e9-84694f0ada89" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Lock "cinder-quobyte-4e59eaec-1c7a-4fb7-a4e9-84694f0ada89" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Deleting offline snapshot 4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 of volume 3a904f80-f4cd-496a-9c52-4dd2ca40dce1 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] snapshot_file for this snap is: volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e423f23-6fde-4156-9fb0-a7a436790b5c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:10 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" returned: 0 in 0.560s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:10 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8 Apr 22 09:28:10 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:10 devstack sudo[90206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 Apr 22 09:28:10 devstack sudo[90206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:10 devstack sudo[90201]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b26a344d-854a-4ccd-afa1-4de0db10db18" returned: 0 in 0.467s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-b26a344d-854a-4ccd-afa1-4de0db10db18" released by "delete_volume" :: held 0.978s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created reservations ['e4b0d488-ec66-4453-90fd-c76d7d610868', '68126451-d084-45c8-91c2-e41d7f05da6d', '6f6743b8-0c97-4df8-84ef-5fc213035dd2', '30a0bede-16b3-4ac1-ad54-c348047d511e'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-e0222591-28e4-44c4-96a7-7114b2d36155-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:10 devstack sudo[90211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:10 devstack sudo[90211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-e0222591-28e4-44c4-96a7-7114b2d36155-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-quobyte-e0222591-28e4-44c4-96a7-7114b2d36155" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-e0222591-28e4-44c4-96a7-7114b2d36155" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb80ee4-6b54-4da6-ad15-acb50e4bddae]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:10 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8" released by "delete_volume" :: held 1.118s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:10 devstack sudo[90206]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89" returned: 0 in 0.549s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96a5297-6272-4145-89ab-07cd603ea365]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:10 devstack sudo[90217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155 Apr 22 09:28:10 devstack sudo[90217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:10 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Created reservations ['6ce38111-c37e-4d19-94b2-bf4129549d05', 'cb7eaa62-f4b2-4aff-8a0e-1221b4eb24b6', '92c1814b-f36f-4d8e-bc65-e1534975d9f9', '4d4f4adb-304c-466b-82dc-3dfd5cc59a95'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:11 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 Apr 22 09:28:11 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:11 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:11 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:11 devstack sudo[90211]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.511s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:11 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Deleted volume successfully. Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-11085d7b-3bd0-4c97-9098-de8df26bca7c tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-b26a344d-854a-4ccd-afa1-4de0db10db18-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:11 devstack sudo[90217]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155" returned: 0 in 0.547s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:11 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155 Apr 22 09:28:11 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:11 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" returned: 0 in 0.508s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:11 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.459s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:11 devstack sudo[90236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 Apr 22 09:28:11 devstack sudo[90236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:11 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Deleted volume successfully. Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-80110cb7-4896-43f7-9622-4df18fdfd6cc tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-9ac2ec37-c81a-45a7-964a-86b9f85e1bc8-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:11 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e0222591-28e4-44c4-96a7-7114b2d36155" returned: 0 in 0.416s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-e0222591-28e4-44c4-96a7-7114b2d36155" released by "delete_volume" :: held 0.982s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created reservations ['25e7fa3a-9d0f-4e8a-b160-794038199655', 'a7312fa3-10af-44f7-913c-7a6ea1205387', '76b088da-230c-4b37-83a3-6df882b7fefc', '2a8311b4-583c-43c0-b7b1-addc17e98826'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:11 devstack sudo[90236]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89" returned: 0 in 0.496s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:11 devstack sudo[90242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:11 devstack sudo[90242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:11 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89 Apr 22 09:28:11 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Flow 'volume_create_manager' (e0d189aa-2116-4a1c-95c1-8ba9f265a615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70ba52d-63d4-440c-9ee7-83257bc51c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e70ba52d-63d4-440c-9ee7-83257bc51c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1562179403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab99a90-041c-4780-aa40-0bbdc81d51a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac53dce68b2b436c935975967f1d6cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:12Z,use_quota=True,user_id='22ac19ce029a4f78a12783eeec115956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269cedb4-b03d-412a-914d-ce1c324be961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (269cedb4-b03d-412a-914d-ce1c324be961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e666773-558e-455b-b0d1-c17d968ef285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e666773-558e-455b-b0d1-c17d968ef285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dab99a90-041c-4780-aa40-0bbdc81d51a0', 'volume_name': 'volume-dab99a90-041c-4780-aa40-0bbdc81d51a0', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1b787b-c8a5-43d7-96eb-44679fc563e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba1b787b-c8a5-43d7-96eb-44679fc563e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1979e462-4027-4738-84ad-5e863d4a9ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:12 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume dab99a90-041c-4780-aa40-0bbdc81d51a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dab99a90-041c-4780-aa40-0bbdc81d51a0', 'volume_size': 1} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1562179403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dab99a90-041c-4780-aa40-0bbdc81d51a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac53dce68b2b436c935975967f1d6cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:12Z,use_quota=True,user_id='22ac19ce029a4f78a12783eeec115956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Creating volume dab99a90-041c-4780-aa40-0bbdc81d51a0 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:12 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:12 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 1073741824 Apr 22 09:28:12 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:12 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1.4e59eaec-1c7a-4fb7-a4e9-84694f0ada89" returned: 0 in 0.419s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Lock "cinder-quobyte-4e59eaec-1c7a-4fb7-a4e9-84694f0ada89" released by "_delete_snapshot" :: held 2.034s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Lock "cinder-quobyte-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" released by "delete_snapshot" :: held 2.045s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:12 devstack sudo[90242]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.490s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Created reservations ['5d35cc7b-4b7a-4cea-9533-512b2f939d99', '8cbc9434-2e11-4820-9eda-f0b7d1483c59', 'a5fb2fed-b2ed-4a73-8166-dd798802cd00', '9120128c-bd06-4edb-bced-32534415c5b6'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:12 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Deleted volume successfully. Apr 22 09:28:12 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Delete snapshot completed successfully. Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2a6b8a44-2a13-4118-8d54-d5fb7b962ca1 tempest-VolumesExtendTest-2069187675 None] Lock "cinder-4e59eaec-1c7a-4fb7-a4e9-84694f0ada89-delete_snapshot" released by "delete_snapshot" :: held 2.144s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a31ac4ac-6724-4df8-9f66-fd897d717f6f tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-e0222591-28e4-44c4-96a7-7114b2d36155-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:12 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 1073741824" returned: 0 in 0.483s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:12 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 Apr 22 09:28:12 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-quobyte-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f7be21-ef48-47ea-9ce2-075c037f2e18]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:13 devstack sudo[90255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6 Apr 22 09:28:13 devstack sudo[90255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:13 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0" returned: 0 in 0.456s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1979e462-4027-4738-84ad-5e863d4a9ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dab99a90-041c-4780-aa40-0bbdc81d51a0', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad82ea2-2539-4e53-b58a-7356a915ecc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:13 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Volume volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 (dab99a90-041c-4780-aa40-0bbdc81d51a0): created successfully Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cad82ea2-2539-4e53-b58a-7356a915ecc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Flow 'volume_create_manager' (e0d189aa-2116-4a1c-95c1-8ba9f265a615) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:13 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-94ac69ed-1194-43e1-890c-a3e862518d69 tempest-VolumesSnapshotTestJSON-1069919655 None] Created volume successfully. Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Acquiring lock "cinder-3a904f80-f4cd-496a-9c52-4dd2ca40dce1-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:13 devstack sudo[90255]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6" returned: 0 in 0.495s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Lock "cinder-3a904f80-f4cd-496a-9c52-4dd2ca40dce1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:13 devstack sudo[90261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6 Apr 22 09:28:13 devstack sudo[90261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Acquiring lock "cinder-quobyte-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Lock "cinder-quobyte-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecfcdd73-2b88-42bd-a546-59905eba5bbd]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:13 devstack sudo[90263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 Apr 22 09:28:13 devstack sudo[90263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:13 devstack sudo[90261]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6" returned: 0 in 0.426s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6" released by "delete_volume" :: held 0.948s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created reservations ['239e5728-6ef7-46ab-8dda-ecb97de51323', '4fda9d3e-8d78-4fac-aff7-ccf2cb7ae0dc', '42132657-2bee-4116-9f1f-4ac02dcca86b', 'b33c0ccc-975d-4dab-9d04-06f0e23fe51a'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:14 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:14 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:14 devstack sudo[90263]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" returned: 0 in 0.481s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-ec88d671-487e-4051-9912-290ed47f0e7d-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:14 devstack sudo[90271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1 Apr 22 09:28:14 devstack sudo[90271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-ec88d671-487e-4051-9912-290ed47f0e7d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-quobyte-ec88d671-487e-4051-9912-290ed47f0e7d" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-ec88d671-487e-4051-9912-290ed47f0e7d" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38e8f0f-e134-438b-8da9-41f40bae81c0]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:14 devstack sudo[90273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d Apr 22 09:28:14 devstack sudo[90273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] Creating offline snapshot c74cda45-9e46-407b-b409-c657a0c94559 of volume dab99a90-041c-4780-aa40-0bbdc81d51a0 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a163d8f8-5a70-4c74-b83a-361261fa5c3b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:14 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.450s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:14 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Deleted volume successfully. Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-a9312735-c0f2-4485-af4d-0ae111e140ea tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-d1fcd578-05ad-4eba-80f4-c5f83db4b7d6-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:14 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 Apr 22 09:28:14 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:14 devstack sudo[90271]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" returned: 0 in 0.464s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Lock "cinder-quobyte-3a904f80-f4cd-496a-9c52-4dd2ca40dce1" released by "delete_volume" :: held 0.970s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Created reservations ['6420a873-95bf-462f-9ed2-9139583cb472', 'c848ea24-f7ad-48f4-870c-7019fac4994e', 'f866171b-4558-4767-a7af-ecc85c6690de', '1c527f5e-aa4d-4923-a06f-0417251b82f1'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:14 devstack sudo[90281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:14 devstack sudo[90281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:14 devstack sudo[90273]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d" returned: 0 in 0.559s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:14 devstack sudo[90284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d Apr 22 09:28:14 devstack sudo[90284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:14 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0" returned: 0 in 0.500s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:14 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 1G Apr 22 09:28:14 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:15 devstack sudo[90281]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.422s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:15 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Deleted volume successfully. Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f2f95e62-c3ac-4361-a115-0eec0fd1a8ae tempest-VolumesExtendTest-2069187675 None] Lock "cinder-3a904f80-f4cd-496a-9c52-4dd2ca40dce1-delete_volume" released by "delete_volume" :: held 1.540s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:15 devstack sudo[90284]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ec88d671-487e-4051-9912-290ed47f0e7d" returned: 0 in 0.424s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-ec88d671-487e-4051-9912-290ed47f0e7d" released by "delete_volume" :: held 1.002s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created reservations ['af5d86fc-23ac-4e7b-88f9-7e44d6db5058', 'ba6b0618-fb5a-4a38-92be-aeb8f44a99e5', '6cb2b152-26da-49fa-9483-78a4bf56278d', 'da279d3b-c8f0-493f-931b-5b09fddd74cd'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:15 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:15 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:15 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 1G" returned: 0 in 0.480s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:15 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 Apr 22 09:28:15 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:15 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.447s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:15 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Deleted volume successfully. Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b0489bd3-dd6e-437a-94bc-f88ea9ddeced tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-ec88d671-487e-4051-9912-290ed47f0e7d-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:15 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559" returned: 0 in 0.460s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:15 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 is being set with open permissions: ugo+rw Apr 22 09:28:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:15 devstack sudo[90304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 Apr 22 09:28:15 devstack sudo[90304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-3374a48b-dafc-4cc1-9e02-bd6f1cf43377-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-3374a48b-dafc-4cc1-9e02-bd6f1cf43377-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-quobyte-3374a48b-dafc-4cc1-9e02-bd6f1cf43377" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:16 devstack sudo[90304]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559" returned: 0 in 0.454s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-3374a48b-dafc-4cc1-9e02-bd6f1cf43377" acquired by "delete_volume" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba189bf1-3dad-449a-97df-adaabaf8fc75]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:16 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.info Apr 22 09:28:16 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:16 devstack sudo[90308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377 Apr 22 09:28:16 devstack sudo[90308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:16 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.info" returned: 0 in 0.478s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:16 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.info is being set with open permissions: ugo+rw Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:16 devstack sudo[90308]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377" returned: 0 in 0.538s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:16 devstack sudo[90316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.info Apr 22 09:28:16 devstack sudo[90316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:16 devstack sudo[90318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377 Apr 22 09:28:16 devstack sudo[90318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:17 devstack sudo[90316]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.info" returned: 0 in 0.432s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.886s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f3e8c47e-996d-4683-a56e-142e791634b2 tempest-VolumesSnapshotTestJSON-1069919655 None] Create snapshot completed successfully Apr 22 09:28:17 devstack sudo[90318]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-3374a48b-dafc-4cc1-9e02-bd6f1cf43377" returned: 0 in 0.429s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-3374a48b-dafc-4cc1-9e02-bd6f1cf43377" released by "delete_volume" :: held 0.991s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created reservations ['6c9fab02-f372-4ac3-9693-b538973ad1c8', '129c0435-85a6-446b-b252-1fd1c5bc44a7', '4c61bbe5-42e4-4bde-80f9-03513dbd5235', '4c02795c-eae5-4deb-9bf8-6ce9eada55cb'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:17 devstack sudo[90322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:17 devstack sudo[90322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Flow 'volume_create_manager' (0e2461a4-e9ef-47cf-9948-1c92e4b5604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95be2fce-ac90-4074-a82b-c077fe681bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95be2fce-ac90-4074-a82b-c077fe681bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2049118037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe67337-c27d-40de-8c18-dd326deef2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d691774298348898a7213be66627746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:17Z,use_quota=True,user_id='a2f85cd150974256849dc77f8ad85af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3302ab27-930a-4f43-9944-cecb8f253dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3302ab27-930a-4f43-9944-cecb8f253dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee5e7f8-e45d-4718-b97d-26b86a86a7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee5e7f8-e45d-4718-b97d-26b86a86a7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fe67337-c27d-40de-8c18-dd326deef2ca', 'volume_name': 'volume-5fe67337-c27d-40de-8c18-dd326deef2ca', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e22b3c-c658-467f-a07d-685a8833e22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37e22b3c-c658-467f-a07d-685a8833e22b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff562e6b-f0ae-430d-b90d-d5615e0d97df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:17 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Volume 5fe67337-c27d-40de-8c18-dd326deef2ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fe67337-c27d-40de-8c18-dd326deef2ca', 'volume_size': 1} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2049118037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fe67337-c27d-40de-8c18-dd326deef2ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d691774298348898a7213be66627746',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:17Z,use_quota=True,user_id='a2f85cd150974256849dc77f8ad85af0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Creating volume 5fe67337-c27d-40de-8c18-dd326deef2ca {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:17 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:17 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca 1073741824 Apr 22 09:28:17 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Flow 'volume_create_manager' (45f562b2-6ce9-415f-b28d-4d7516b1a37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48e0f21-771d-479f-8cca-5ccaaa3045a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c48e0f21-771d-479f-8cca-5ccaaa3045a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-326607720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c796761-5953-4822-9842-f50d757f9ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac53dce68b2b436c935975967f1d6cca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c74cda45-9e46-407b-b409-c657a0c94559,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:18Z,use_quota=True,user_id='22ac19ce029a4f78a12783eeec115956',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:17 devstack sudo[90322]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a679f5eb-b483-4c5b-baa9-bb36480d1ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a679f5eb-b483-4c5b-baa9-bb36480d1ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3264403-4ed6-4b65-9223-73cfef941b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3264403-4ed6-4b65-9223-73cfef941b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0c796761-5953-4822-9842-f50d757f9ecb', 'volume_name': 'volume-0c796761-5953-4822-9842-f50d757f9ecb', 'volume_size': 1, 'snapshot_id': 'c74cda45-9e46-407b-b409-c657a0c94559'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0874b0f9-9518-41e8-94d5-cfc617f94f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0874b0f9-9518-41e8-94d5-cfc617f94f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efd2e6f-2a9e-4517-b997-d7092f1cf9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:17 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Volume 0c796761-5953-4822-9842-f50d757f9ecb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0c796761-5953-4822-9842-f50d757f9ecb', 'volume_size': 1, 'snapshot_id': 'c74cda45-9e46-407b-b409-c657a0c94559'} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.456s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Deleted volume successfully. Apr 22 09:28:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2499a11c-2b78-4c3a-8df1-86477cb7dc58 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-3374a48b-dafc-4cc1-9e02-bd6f1cf43377-delete_volume" released by "delete_volume" :: held 1.594s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:18 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca 1073741824" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:18 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca Apr 22 09:28:18 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-e9502321-3a1b-4e90-a392-114b14b20cc6-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-e9502321-3a1b-4e90-a392-114b14b20cc6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:18 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca" returned: 0 in 0.422s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.620s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-c74cda45-9e46-407b-b409-c657a0c94559-0c796761-5953-4822-9842-f50d757f9ecb" by "_create_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff562e6b-f0ae-430d-b90d-d5615e0d97df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fe67337-c27d-40de-8c18-dd326deef2ca', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1605e4-ffd4-4846-896d-2156f0998e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-c74cda45-9e46-407b-b409-c657a0c94559-0c796761-5953-4822-9842-f50d757f9ecb" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Creating volume 0c796761-5953-4822-9842-f50d757f9ecb from snapshot c74cda45-9e46-407b-b409-c657a0c94559 {{(pid=82642) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-0c796761-5953-4822-9842-f50d757f9ecb" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "cinder-quobyte-e9502321-3a1b-4e90-a392-114b14b20cc6" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:18 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Volume volume-5fe67337-c27d-40de-8c18-dd326deef2ca (5fe67337-c27d-40de-8c18-dd326deef2ca): created successfully Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1605e4-ffd4-4846-896d-2156f0998e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Flow 'volume_create_manager' (0e2461a4-e9ef-47cf-9948-1c92e4b5604f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-0c796761-5953-4822-9842-f50d757f9ecb" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] snapshot: c74cda45-9e46-407b-b409-c657a0c94559, volume: 0c796761-5953-4822-9842-f50d757f9ecb, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:28:18 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6892a489-a838-49c5-a947-89c24ac1bfed tempest-VolumesNegativeTest-364949025 None] Created volume successfully. Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-e9502321-3a1b-4e90-a392-114b14b20cc6" acquired by "delete_volume" :: waited 0.031s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6eb0566-aa24-45dc-83de-90827d7d0d10]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b70083-8763-4a88-9a27-20d0fcd09e5c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:18 devstack sudo[90333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6 Apr 22 09:28:18 devstack sudo[90333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:18 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 Apr 22 09:28:18 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:19 devstack sudo[90333]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6" returned: 0 in 0.467s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:19 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559" returned: 0 in 0.468s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dab99a90-041c-4780-aa40-0bbdc81d51a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d16e7c4d-e358-4e2e-a4e7-a9488b4dff55]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:19 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6 Apr 22 09:28:19 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:19 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 Apr 22 09:28:19 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:19 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-e9502321-3a1b-4e90-a392-114b14b20cc6" returned: 0 in 0.396s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-quobyte-e9502321-3a1b-4e90-a392-114b14b20cc6" released by "delete_volume" :: held 0.892s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Created reservations ['148a4234-7817-484b-8002-2ad0e7fe0bbe', '632e9019-0d44-4474-bde7-d8da8b138d5b', '1b89ff6f-a411-45b8-a65d-f621ea636393', '7cd9d2b4-053f-4e22-bd59-8728c91926b7'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:19 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0" returned: 0 in 0.468s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:19 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb Apr 22 09:28:19 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:19 devstack sudo[90353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:19 devstack sudo[90353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:20 devstack sudo[90353]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.914s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:20 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:20 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Deleted volume successfully. Apr 22 09:28:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bdb33b12-9d0f-44be-8301-d16517172e26 tempest-CreateVolumesFromSourceVolumeTest-1236927774 None] Lock "cinder-e9502321-3a1b-4e90-a392-114b14b20cc6-delete_volume" released by "delete_volume" :: held 2.058s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:21 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb" returned: 0 in 2.424s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:22 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9460e5ba-22bd-4654-874a-ed4ec738ba9c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:22 devstack sudo[90374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 Apr 22 09:28:22 devstack sudo[90374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:22 devstack sudo[90374]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0" returned: 0 in 0.583s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:22 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0, size 1024.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:28:22 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Converted 1024.00 MB image at 422.20 MB/s Apr 22 09:28:22 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb is being set with open permissions: ugo+rw Apr 22 09:28:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:22 devstack sudo[90379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb Apr 22 09:28:22 devstack sudo[90379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:23 devstack sudo[90379]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb" returned: 0 in 0.434s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-0c796761-5953-4822-9842-f50d757f9ecb" released by "_copy_volume_from_snapshot" :: held 4.453s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-c74cda45-9e46-407b-b409-c657a0c94559-0c796761-5953-4822-9842-f50d757f9ecb" released by "_create_volume_from_snapshot" :: held 4.485s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.513s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6efd2e6f-2a9e-4517-b997-d7092f1cf9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c796761-5953-4822-9842-f50d757f9ecb', 'volume_size': 1, 'snapshot_id': 'c74cda45-9e46-407b-b409-c657a0c94559'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4ba8db-6c0a-4fef-a610-09f7242ad264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:23 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Volume volume-0c796761-5953-4822-9842-f50d757f9ecb (0c796761-5953-4822-9842-f50d757f9ecb): created successfully Apr 22 09:28:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de4ba8db-6c0a-4fef-a610-09f7242ad264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Flow 'volume_create_manager' (45f562b2-6ce9-415f-b28d-4d7516b1a37f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:23 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-bbec4311-b93d-4316-aab7-80bc2f1f571d tempest-VolumesSnapshotTestJSON-1069919655 None] Created volume successfully. Apr 22 09:28:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-0c796761-5953-4822-9842-f50d757f9ecb-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-0c796761-5953-4822-9842-f50d757f9ecb-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-0c796761-5953-4822-9842-f50d757f9ecb" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-0c796761-5953-4822-9842-f50d757f9ecb" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:24 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3846cd71-a013-4582-a6f6-754f2cd18816]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:24 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb Apr 22 09:28:24 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:24 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb" returned: 0 in 0.469s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:24 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb Apr 22 09:28:24 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:25 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0c796761-5953-4822-9842-f50d757f9ecb" returned: 0 in 0.404s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-0c796761-5953-4822-9842-f50d757f9ecb" released by "delete_volume" :: held 0.907s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Created reservations ['3521264f-338e-4c96-9662-bdd4915c158d', 'c8468d29-b8e2-41f2-a2a9-ab58ecccf0a5', '15f186fe-e26d-462b-abd1-3c62bee668cd', 'f8d5d818-290f-484b-a422-883684747d14'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:25 devstack sudo[90390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:25 devstack sudo[90390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-c74cda45-9e46-407b-b409-c657a0c94559-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-c74cda45-9e46-407b-b409-c657a0c94559-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-dab99a90-041c-4780-aa40-0bbdc81d51a0" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-dab99a90-041c-4780-aa40-0bbdc81d51a0" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-c74cda45-9e46-407b-b409-c657a0c94559" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-c74cda45-9e46-407b-b409-c657a0c94559" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Deleting offline snapshot c74cda45-9e46-407b-b409-c657a0c94559 of volume dab99a90-041c-4780-aa40-0bbdc81d51a0 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] snapshot_file for this snap is: volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[600eb9e7-29bb-423e-bf7c-176af613d61f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:25 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 Apr 22 09:28:25 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:25 devstack sudo[90390]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.472s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:25 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Deleted volume successfully. Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f7e58d51-9f56-4afe-99da-819371efdb7a tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-0c796761-5953-4822-9842-f50d757f9ecb-delete_volume" released by "delete_volume" :: held 1.495s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:25 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559" returned: 0 in 0.532s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dab99a90-041c-4780-aa40-0bbdc81d51a0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:28:25 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[13129899-f07f-4845-ad7b-179553cb3fbe]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:26 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 Apr 22 09:28:26 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:26 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0" returned: 0 in 0.596s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:26 devstack sudo[90404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 Apr 22 09:28:26 devstack sudo[90404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:27 devstack sudo[90404]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559" returned: 0 in 0.480s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:27 devstack sudo[90409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559 Apr 22 09:28:27 devstack sudo[90409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:27 devstack sudo[90409]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0.c74cda45-9e46-407b-b409-c657a0c94559" returned: 0 in 0.465s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-c74cda45-9e46-407b-b409-c657a0c94559" released by "_delete_snapshot" :: held 2.132s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-dab99a90-041c-4780-aa40-0bbdc81d51a0" released by "delete_snapshot" :: held 2.143s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:27 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Created reservations ['abb6e097-5fc9-4772-90e6-f232ea7ba51e', 'df650da9-3e98-4f57-8e87-053a5831163c', '974a0494-aed6-44ec-8ce4-f86d3e919c95', '7ea51cfe-fa94-45ca-872f-11f2c42fe99c'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:27 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Delete snapshot completed successfully. Apr 22 09:28:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-24154952-e1d8-4dde-913e-f49a8ed657e2 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-c74cda45-9e46-407b-b409-c657a0c94559-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:28 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-dab99a90-041c-4780-aa40-0bbdc81d51a0-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:28 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-dab99a90-041c-4780-aa40-0bbdc81d51a0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:28 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-dab99a90-041c-4780-aa40-0bbdc81d51a0" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:28 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-dab99a90-041c-4780-aa40-0bbdc81d51a0" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:28 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[43073870-5955-4745-85df-67d9ca164b97]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:28 devstack sudo[90428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 Apr 22 09:28:28 devstack sudo[90428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:29 devstack sudo[90428]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0" returned: 0 in 0.489s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:29 devstack sudo[90433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0 Apr 22 09:28:29 devstack sudo[90433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:29 devstack sudo[90433]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-dab99a90-041c-4780-aa40-0bbdc81d51a0" returned: 0 in 0.410s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-dab99a90-041c-4780-aa40-0bbdc81d51a0" released by "delete_volume" :: held 0.931s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Created reservations ['5032f4e8-92b6-4d73-9180-89d040e412ef', '61cfd8a7-7def-48e4-8dea-7b8d7620c394', '715d175d-d221-435c-ae63-8508e569bcf4', '6afd906a-6a3e-489f-8428-ef49d04a1e4c'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:29 devstack sudo[90436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:29 devstack sudo[90436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-312ff1a2-3c45-4b1d-bbe4-69c4495b4021-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-312ff1a2-3c45-4b1d-bbe4-69c4495b4021-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "cinder-quobyte-312ff1a2-3c45-4b1d-bbe4-69c4495b4021" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-312ff1a2-3c45-4b1d-bbe4-69c4495b4021" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0a8752-41c2-47fe-884c-5de791dd5271]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:29 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 Apr 22 09:28:29 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:30 devstack sudo[90436]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.442s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:30 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Deleted volume successfully. Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c89e147d-2361-49c6-822d-d2fbd7f76416 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-dab99a90-041c-4780-aa40-0bbdc81d51a0-delete_volume" released by "delete_volume" :: held 1.512s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:30 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021" returned: 0 in 0.482s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:30 devstack sudo[90447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021 Apr 22 09:28:30 devstack sudo[90447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_service.periodic_task [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:30 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:30 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:30 devstack sudo[90447]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-312ff1a2-3c45-4b1d-bbe4-69c4495b4021" returned: 0 in 0.431s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-quobyte-312ff1a2-3c45-4b1d-bbe4-69c4495b4021" released by "delete_volume" :: held 0.941s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=244,cinder:UPDATE=317,cinder:INSERT=85,cinder:DELETE=24 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Created reservations ['880be465-13ea-4845-b7af-1338264e6488', 'dcc9aee3-71fa-447d-b6e4-15b706fb9712', '016dbb23-2bf2-47c3-9797-cdb091d4a050', 'd81803db-7dd2-4c01-8069-24549f825094'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:30 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:30 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:31 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.459s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:31 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:31 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.443s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:31 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:31 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Deleted volume successfully. Apr 22 09:28:31 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce44453a-d8ca-44e3-b0ae-228e039778a7 tempest-VolumesSnapshotTestJSON-1069919655 None] Lock "cinder-312ff1a2-3c45-4b1d-bbe4-69c4495b4021-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:UPDATE=291,cinder:DELETE=27,cinder:SELECT=202,cinder:INSERT=71 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Flow 'volume_create_manager' (d817e1c0-ec25-438b-81c8-924bdb994843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45d4437-f7e9-4a63-a9f6-778562d724e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b45d4437-f7e9-4a63-a9f6-778562d724e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1971484428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260d2b73-266a-45e1-9b14-cd4512431e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb5ac789e104bac83362e9ae0c43ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:36Z,use_quota=True,user_id='fffa0de2dddc4b66a5eaedf3dae94b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8d0474-28f3-4106-a415-053299ea4ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb8d0474-28f3-4106-a415-053299ea4ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04db1a6-f5c2-471c-9a65-cae1cbb948f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04db1a6-f5c2-471c-9a65-cae1cbb948f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '260d2b73-266a-45e1-9b14-cd4512431e96', 'volume_name': 'volume-260d2b73-266a-45e1-9b14-cd4512431e96', 'volume_size': 2}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78dd01c7-191e-46ad-8f8a-0f442c428239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78dd01c7-191e-46ad-8f8a-0f442c428239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b18c80d-9ab7-45b6-8ed8-1cf6fc1793ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:35 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Volume 260d2b73-266a-45e1-9b14-cd4512431e96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-260d2b73-266a-45e1-9b14-cd4512431e96', 'volume_size': 2} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1971484428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=260d2b73-266a-45e1-9b14-cd4512431e96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7eb5ac789e104bac83362e9ae0c43ed4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:36Z,use_quota=True,user_id='fffa0de2dddc4b66a5eaedf3dae94b83',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Creating volume 260d2b73-266a-45e1-9b14-cd4512431e96 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:35 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:28:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 2147483648 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:35 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 2147483648 Apr 22 09:28:35 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:36 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 2147483648" returned: 0 in 0.537s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:36 devstack sudo[90514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 Apr 22 09:28:36 devstack sudo[90514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:36 devstack sudo[90514]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96" returned: 0 in 0.389s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:28:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b18c80d-9ab7-45b6-8ed8-1cf6fc1793ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-260d2b73-266a-45e1-9b14-cd4512431e96', 'volume_size': 2}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6f43f5-a16f-4a0d-8a7f-e49a6e3f61ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:36 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Volume volume-260d2b73-266a-45e1-9b14-cd4512431e96 (260d2b73-266a-45e1-9b14-cd4512431e96): created successfully Apr 22 09:28:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd6f43f5-a16f-4a0d-8a7f-e49a6e3f61ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:36 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Flow 'volume_create_manager' (d817e1c0-ec25-438b-81c8-924bdb994843) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:36 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-dd3d0d09-013a-432c-8b58-952903256207 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Created volume successfully. Apr 22 09:28:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:37 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Creating offline snapshot 9d71a4ea-05fe-4471-9ba8-fdd048d4f576 of volume 260d2b73-266a-45e1-9b14-cd4512431e96 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:28:37 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[64115bf0-27e2-4031-8b50-73a491095e40]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:38 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 Apr 22 09:28:38 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:38 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96" returned: 0 in 0.485s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 2G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:38 devstack sudo[90555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 2G Apr 22 09:28:38 devstack sudo[90555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:38 devstack sudo[90555]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 2G" returned: 0 in 0.507s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260d2b73-266a-45e1-9b14-cd4512431e96 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:38 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260d2b73-266a-45e1-9b14-cd4512431e96 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 Apr 22 09:28:38 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:39 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-260d2b73-266a-45e1-9b14-cd4512431e96 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576" returned: 0 in 0.434s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:39 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 is being set with open permissions: ugo+rw Apr 22 09:28:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:39 devstack sudo[90600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 Apr 22 09:28:39 devstack sudo[90600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:39 devstack sudo[90600]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576" returned: 0 in 0.422s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:39 devstack sudo[90603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.info Apr 22 09:28:39 devstack sudo[90603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:40 devstack sudo[90603]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.info" returned: 0 in 0.404s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:40 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.info is being set with open permissions: ugo+rw Apr 22 09:28:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:40 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.info Apr 22 09:28:40 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:40 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.info" returned: 0 in 0.435s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:40 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-62636d7d-032d-42d0-9fec-945c94c6b2f3 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Create snapshot completed successfully Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Acquiring lock "cinder-9d71a4ea-05fe-4471-9ba8-fdd048d4f576-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "cinder-9d71a4ea-05fe-4471-9ba8-fdd048d4f576-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Acquiring lock "cinder-quobyte-260d2b73-266a-45e1-9b14-cd4512431e96" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "cinder-quobyte-260d2b73-266a-45e1-9b14-cd4512431e96" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Acquiring lock "cinder-quobyte-9d71a4ea-05fe-4471-9ba8-fdd048d4f576" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "cinder-quobyte-9d71a4ea-05fe-4471-9ba8-fdd048d4f576" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Deleting offline snapshot 9d71a4ea-05fe-4471-9ba8-fdd048d4f576 of volume 260d2b73-266a-45e1-9b14-cd4512431e96 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] snapshot_file for this snap is: volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec8a550-b918-469f-80d8-0d6c8dedbb91]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:41 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 Apr 22 09:28:41 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:41 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576" returned: 0 in 0.466s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-260d2b73-266a-45e1-9b14-cd4512431e96(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3f7bf6-a574-43c4-9b8a-798b56da0e08]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:41 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 Apr 22 09:28:41 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:42 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96" returned: 0 in 0.466s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:42 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 Apr 22 09:28:42 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:42 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576" returned: 0 in 0.445s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:42 devstack sudo[90625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576 Apr 22 09:28:42 devstack sudo[90625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:42 devstack sudo[90625]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96.9d71a4ea-05fe-4471-9ba8-fdd048d4f576" returned: 0 in 0.408s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:42 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "cinder-quobyte-9d71a4ea-05fe-4471-9ba8-fdd048d4f576" released by "_delete_snapshot" :: held 1.849s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:42 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "cinder-quobyte-260d2b73-266a-45e1-9b14-cd4512431e96" released by "delete_snapshot" :: held 1.862s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:43 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Created reservations ['1885bf32-d260-4024-9748-94621458c24c', 'b0735341-2a54-41a9-93f5-6200ffcc5aa8', '1c1194e1-bb17-4a53-9fa4-4e08359d214d', '89c36a65-1a76-4602-9bed-0e2c8c8cac2e'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:43 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Delete snapshot completed successfully. Apr 22 09:28:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-82807d82-83c6-4f53-b1b2-bd017ba76932 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "cinder-9d71a4ea-05fe-4471-9ba8-fdd048d4f576-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Acquiring lock "cinder-260d2b73-266a-45e1-9b14-cd4512431e96-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "cinder-260d2b73-266a-45e1-9b14-cd4512431e96-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Acquiring lock "cinder-quobyte-260d2b73-266a-45e1-9b14-cd4512431e96" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:43 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "cinder-quobyte-260d2b73-266a-45e1-9b14-cd4512431e96" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:43 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[04193aad-716e-408d-8322-a5e529842a1b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:43 devstack sudo[90628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 Apr 22 09:28:43 devstack sudo[90628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:43 devstack sudo[90628]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96" returned: 0 in 0.487s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:43 devstack sudo[90633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96 Apr 22 09:28:43 devstack sudo[90633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:44 devstack sudo[90633]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-260d2b73-266a-45e1-9b14-cd4512431e96" returned: 0 in 0.424s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "cinder-quobyte-260d2b73-266a-45e1-9b14-cd4512431e96" released by "delete_volume" :: held 0.950s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Created reservations ['ce9d52b5-b99e-40d9-94da-a23fe186b94e', '1e79115c-0c66-414e-88a5-09f52315ffaf', 'da1fe3ea-e154-41d1-bd75-73ac41313a60', 'e3be4186-e62b-442a-8f0f-f7954266b47e'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:44 devstack sudo[90637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:44 devstack sudo[90637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:44 devstack sudo[90637]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.547s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:44 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Deleted volume successfully. Apr 22 09:28:44 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ea72122b-a56d-440a-93df-4c50f641e187 tempest-VolumesSnapshotNegativeTestJSON-1251699756 None] Lock "cinder-260d2b73-266a-45e1-9b14-cd4512431e96-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Flow 'volume_create_manager' (d39fbaac-2c1d-4129-8c60-58adb53969b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfe358e-fcf8-4d9b-be8b-6cdaaa33d8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abfe358e-fcf8-4d9b-be8b-6cdaaa33d8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1397381836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f6bb39-2a04-4c32-84d5-cbe8e051a75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c42271030d2475e8debd550d351326f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:46Z,use_quota=True,user_id='fe903446841b4752adcaa9bfccb624e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42a308b-e47b-4515-bc31-ce4e461ad74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a42a308b-e47b-4515-bc31-ce4e461ad74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fac7b3-0811-4ca7-bbed-04a2ce13f112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8fac7b3-0811-4ca7-bbed-04a2ce13f112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65f6bb39-2a04-4c32-84d5-cbe8e051a75a', 'volume_name': 'volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4df901-4e12-40ac-8acf-8da4abab78ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4df901-4e12-40ac-8acf-8da4abab78ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984de83e-7c1e-48e4-bdf5-fb4ce8160a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:46 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Volume 65f6bb39-2a04-4c32-84d5-cbe8e051a75a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a', 'volume_size': 1} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1397381836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f6bb39-2a04-4c32-84d5-cbe8e051a75a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c42271030d2475e8debd550d351326f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:46Z,use_quota=True,user_id='fe903446841b4752adcaa9bfccb624e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Creating volume 65f6bb39-2a04-4c32-84d5-cbe8e051a75a {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:46 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:46 devstack sudo[90641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a 1073741824 Apr 22 09:28:46 devstack sudo[90641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:46 devstack sudo[90641]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a 1073741824" returned: 0 in 0.498s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:46 devstack sudo[90646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a Apr 22 09:28:46 devstack sudo[90646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Acquiring lock "cinder-5fe67337-c27d-40de-8c18-dd326deef2ca-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Lock "cinder-5fe67337-c27d-40de-8c18-dd326deef2ca-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Acquiring lock "cinder-quobyte-5fe67337-c27d-40de-8c18-dd326deef2ca" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Lock "cinder-quobyte-5fe67337-c27d-40de-8c18-dd326deef2ca" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:46 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[65341529-be73-45b8-9b15-526eb5e0e6b8]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:47 devstack sudo[90646]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" returned: 0 in 0.406s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] <== create_volume: return (937ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (984de83e-7c1e-48e4-bdf5-fb4ce8160a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:47 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca Apr 22 09:28:47 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb4ae82-9640-451a-8f9c-1d6d148bd654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:47 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Volume volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a (65f6bb39-2a04-4c32-84d5-cbe8e051a75a): created successfully Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0cb4ae82-9640-451a-8f9c-1d6d148bd654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Flow 'volume_create_manager' (d39fbaac-2c1d-4129-8c60-58adb53969b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:47 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7494cbc9-2e9e-43b2-aa11-169a13955a53 tempest-VolumeDependencyTests-713939473 None] Created volume successfully. Apr 22 09:28:47 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca" returned: 0 in 0.473s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:47 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca Apr 22 09:28:47 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:47 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5fe67337-c27d-40de-8c18-dd326deef2ca" returned: 0 in 0.395s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Lock "cinder-quobyte-5fe67337-c27d-40de-8c18-dd326deef2ca" released by "delete_volume" :: held 0.893s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Created reservations ['e947a73b-97cd-419f-9177-962927e1e78a', '6c7a3ccd-439d-4afb-bd63-91f479e413b5', '6c6026ff-fd90-47f2-9e0e-c07967c32294', 'c5321274-a006-434a-baee-dbabd38a9bcb'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:47 devstack sudo[90658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:28:47 devstack sudo[90658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] Creating offline snapshot 64cb71ec-edfa-40be-aea0-8dc3b4336699 of volume 65f6bb39-2a04-4c32-84d5-cbe8e051a75a {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:28:48 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[db087418-34c9-4bda-a7b7-8644996bb8ca]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:48 devstack sudo[90658]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.411s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:48 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:28:48 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Deleted volume successfully. Apr 22 09:28:48 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-2acce0b7-46b9-45f0-9d80-459657180dc7 tempest-VolumesNegativeTest-364949025 None] Lock "cinder-5fe67337-c27d-40de-8c18-dd326deef2ca-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:48 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a Apr 22 09:28:48 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:48 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" returned: 0 in 0.544s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:48 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 1G Apr 22 09:28:48 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:49 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 1G" returned: 0 in 0.481s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:49 devstack sudo[90671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 Apr 22 09:28:49 devstack sudo[90671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Flow 'volume_create_manager' (faff0eaa-ee20-43c1-9d76-296dc66f2df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1493dd1-9067-49c5-8d7e-44e32657b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1493dd1-9067-49c5-8d7e-44e32657b160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66766fa7-1135-4a2c-a16a-b6af92a7a67b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9adb2b15e9e4faf99ff58d0882a45fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:49Z,use_quota=True,user_id='b0c56ef9428e4d85872145c03dedd28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ac1e71-8386-4f62-87b1-d68cc1529d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02ac1e71-8386-4f62-87b1-d68cc1529d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef25e48-7ec8-4f02-a7b3-e09dbadd7774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef25e48-7ec8-4f02-a7b3-e09dbadd7774) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66766fa7-1135-4a2c-a16a-b6af92a7a67b', 'volume_name': 'volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d9f7bc-720a-4814-a4e2-807b02391533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d9f7bc-720a-4814-a4e2-807b02391533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e89147-677a-4570-bf71-c94dea238c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:49 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Volume 66766fa7-1135-4a2c-a16a-b6af92a7a67b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b', 'volume_size': 1} Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:49 devstack sudo[90671]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699" returned: 0 in 0.435s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:49 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 is being set with open permissions: ugo+rw Apr 22 09:28:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:49 devstack sudo[90676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 Apr 22 09:28:49 devstack sudo[90676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:50 devstack sudo[90676]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699" returned: 0 in 0.386s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:50 devstack sudo[90679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.info Apr 22 09:28:50 devstack sudo[90679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:50 devstack sudo[90679]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.info" returned: 0 in 0.420s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:50 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.info is being set with open permissions: ugo+rw Apr 22 09:28:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:50 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.info Apr 22 09:28:50 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:51 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.info" returned: 0 in 0.393s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.712s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66766fa7-1135-4a2c-a16a-b6af92a7a67b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9adb2b15e9e4faf99ff58d0882a45fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:49Z,use_quota=True,user_id='b0c56ef9428e4d85872145c03dedd28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Creating volume 66766fa7-1135-4a2c-a16a-b6af92a7a67b {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:51 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:51 devstack sudo[90685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b 1073741824 Apr 22 09:28:51 devstack sudo[90685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:51 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4d78977b-35c2-4152-9493-6dabe69010ca tempest-VolumeDependencyTests-713939473 None] Create snapshot completed successfully Apr 22 09:28:51 devstack sudo[90685]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b 1073741824" returned: 0 in 0.475s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:51 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b Apr 22 09:28:51 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Flow 'volume_create_manager' (8386daee-25de-46d1-ae12-0d17eddcac03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81140e2-fca3-464b-aa66-4d85c10ba76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f81140e2-fca3-464b-aa66-4d85c10ba76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-72665133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c42271030d2475e8debd550d351326f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=64cb71ec-edfa-40be-aea0-8dc3b4336699,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:52Z,use_quota=True,user_id='fe903446841b4752adcaa9bfccb624e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68de18ef-d31c-4190-af34-ad1eb233078c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68de18ef-d31c-4190-af34-ad1eb233078c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4525f40b-500f-4809-9584-0c4359d100ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4525f40b-500f-4809-9584-0c4359d100ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7', 'volume_name': 'volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7', 'volume_size': 1, 'snapshot_id': '64cb71ec-edfa-40be-aea0-8dc3b4336699'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b8f7f9-e8a7-4283-bcfe-86bd22c2861b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b8f7f9-e8a7-4283-bcfe-86bd22c2861b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4bffcb2-ef0a-4a9a-bd86-2bbfb41fc7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:51 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Volume 15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7', 'volume_size': 1, 'snapshot_id': '64cb71ec-edfa-40be-aea0-8dc3b4336699'} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:51 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b" returned: 0 in 0.426s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.180s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-quobyte-64cb71ec-edfa-40be-aea0-8dc3b4336699-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" by "_create_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32e89147-677a-4570-bf71-c94dea238c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007e46f3-e27d-49dd-b401-882cc11fdbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-64cb71ec-edfa-40be-aea0-8dc3b4336699-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Creating volume 15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 from snapshot 64cb71ec-edfa-40be-aea0-8dc3b4336699 {{(pid=82642) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:51 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-quobyte-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:51 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Volume volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b (66766fa7-1135-4a2c-a16a-b6af92a7a67b): created successfully Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (007e46f3-e27d-49dd-b401-882cc11fdbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Flow 'volume_create_manager' (faff0eaa-ee20-43c1-9d76-296dc66f2df1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] snapshot: 64cb71ec-edfa-40be-aea0-8dc3b4336699, volume: 15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:28:52 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f3186af7-c9e7-4163-8060-7d4ef00a26f7 tempest-CinderUnicodeTest-805609501 None] Created volume successfully. Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a052bbe-cdd2-4aff-9486-a10e5513babe]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:52 devstack sudo[90694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 Apr 22 09:28:52 devstack sudo[90694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:52 devstack sudo[90694]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699" returned: 0 in 0.461s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e491ca-7bbf-427d-b729-af0cc0e50f7c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:52 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a Apr 22 09:28:52 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Flow 'volume_create_manager' (11e6163e-506a-4098-b112-fa5ac16b3ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cddcbdf-f22f-4656-a361-524e53e07048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cddcbdf-f22f-4656-a361-524e53e07048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-695017999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f0c95f-3813-41b1-9f11-132af2a13336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9adb2b15e9e4faf99ff58d0882a45fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:53Z,use_quota=True,user_id='b0c56ef9428e4d85872145c03dedd28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63ef055-41a7-42db-afda-6fafc02fa0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c63ef055-41a7-42db-afda-6fafc02fa0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3ebd2f-3a52-4ed7-985f-9b2096d0954d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d3ebd2f-3a52-4ed7-985f-9b2096d0954d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08f0c95f-3813-41b1-9f11-132af2a13336', 'volume_name': 'volume-08f0c95f-3813-41b1-9f11-132af2a13336', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b114df-5ca7-42c4-abed-0c5dc667d7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3b114df-5ca7-42c4-abed-0c5dc667d7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8744286c-dfc2-4661-b9f7-d44c911b9242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:52 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Volume 08f0c95f-3813-41b1-9f11-132af2a13336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08f0c95f-3813-41b1-9f11-132af2a13336', 'volume_size': 1} Apr 22 09:28:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:53 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" returned: 0 in 0.515s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:53 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:28:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:53 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 Apr 22 09:28:53 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:54 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" returned: 0 in 1.876s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:54 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b303a7-7b82-4ca0-b7db-a3c5bc93334f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:54 devstack sudo[90716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a Apr 22 09:28:54 devstack sudo[90716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:55 devstack sudo[90716]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" returned: 0 in 0.569s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a, size 1024.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:28:55 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Converted 1024.00 MB image at 545.36 MB/s Apr 22 09:28:55 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 is being set with open permissions: ugo+rw Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:55 devstack sudo[90721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 Apr 22 09:28:55 devstack sudo[90721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:55 devstack sudo[90721]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" returned: 0 in 0.386s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" released by "_copy_volume_from_snapshot" :: held 3.862s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-64cb71ec-edfa-40be-aea0-8dc3b4336699-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" released by "_create_volume_from_snapshot" :: held 3.891s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.911s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.922s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:28:53Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-695017999',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08f0c95f-3813-41b1-9f11-132af2a13336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b9adb2b15e9e4faf99ff58d0882a45fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:28:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:28:53Z,use_quota=True,user_id='b0c56ef9428e4d85872145c03dedd28e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Creating volume 08f0c95f-3813-41b1-9f11-132af2a13336 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:28:55 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:55 devstack sudo[90724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 1073741824 Apr 22 09:28:55 devstack sudo[90724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4bffcb2-ef0a-4a9a-bd86-2bbfb41fc7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7', 'volume_size': 1, 'snapshot_id': '64cb71ec-edfa-40be-aea0-8dc3b4336699'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb4f91e-00d0-4f59-8a33-f12400fc72c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:55 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Volume volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 (15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7): created successfully Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb4f91e-00d0-4f59-8a33-f12400fc72c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Flow 'volume_create_manager' (8386daee-25de-46d1-ae12-0d17eddcac03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:55 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-3f6caa36-16e5-4e64-a656-9fac0b7fa773 tempest-VolumeDependencyTests-713939473 None] Created volume successfully. Apr 22 09:28:56 devstack sudo[90724]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 1073741824" returned: 0 in 0.470s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:56 devstack sudo[90729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 Apr 22 09:28:56 devstack sudo[90729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:56 devstack sudo[90729]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336" returned: 0 in 0.416s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:28:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8744286c-dfc2-4661-b9f7-d44c911b9242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08f0c95f-3813-41b1-9f11-132af2a13336', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ac3552-2f1d-4b19-9a39-5c26c2319714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:28:56 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Volume volume-08f0c95f-3813-41b1-9f11-132af2a13336 (08f0c95f-3813-41b1-9f11-132af2a13336): created successfully Apr 22 09:28:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04ac3552-2f1d-4b19-9a39-5c26c2319714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:28:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Flow 'volume_create_manager' (11e6163e-506a-4098-b112-fa5ac16b3ba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:28:56 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-2106a088-52a7-43cd-bcaa-22ec14c2cb13 tempest-CinderUnicodeTest-805609501 None] Created volume successfully. Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-64cb71ec-edfa-40be-aea0-8dc3b4336699-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-64cb71ec-edfa-40be-aea0-8dc3b4336699-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-quobyte-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-quobyte-64cb71ec-edfa-40be-aea0-8dc3b4336699" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-64cb71ec-edfa-40be-aea0-8dc3b4336699" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Deleting offline snapshot 64cb71ec-edfa-40be-aea0-8dc3b4336699 of volume 65f6bb39-2a04-4c32-84d5-cbe8e051a75a {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] snapshot_file for this snap is: volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c930a1a9-55e4-4a97-92ff-0d147cf3ca55]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:57 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 Apr 22 09:28:57 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] Creating offline snapshot 8baefca5-a48d-48cb-8f41-25ec8ace8ce2 of volume 08f0c95f-3813-41b1-9f11-132af2a13336 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e58cff6-4c61-43e5-8d66-961db585c47f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:57 devstack sudo[90734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 Apr 22 09:28:57 devstack sudo[90734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:57 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699" returned: 0 in 0.488s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4e7ecb-9b62-47c4-802a-c90a9f1bda88]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:57 devstack sudo[90739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a Apr 22 09:28:57 devstack sudo[90739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:57 devstack sudo[90734]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336" returned: 0 in 0.468s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:57 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 1G Apr 22 09:28:57 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:58 devstack sudo[90739]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" returned: 0 in 0.465s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:58 devstack sudo[90749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 Apr 22 09:28:58 devstack sudo[90749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:58 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 1G" returned: 0 in 0.462s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f0c95f-3813-41b1-9f11-132af2a13336 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:58 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f0c95f-3813-41b1-9f11-132af2a13336 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 Apr 22 09:28:58 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:58 devstack sudo[90749]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699" returned: 0 in 0.456s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:58 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699 Apr 22 09:28:58 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:58 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08f0c95f-3813-41b1-9f11-132af2a13336 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2" returned: 0 in 0.459s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:58 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 is being set with open permissions: ugo+rw Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:58 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 Apr 22 09:28:58 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:58 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a.64cb71ec-edfa-40be-aea0-8dc3b4336699" returned: 0 in 0.407s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-64cb71ec-edfa-40be-aea0-8dc3b4336699" released by "_delete_snapshot" :: held 1.866s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" released by "delete_snapshot" :: held 1.878s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:58 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Created reservations ['592b4897-ba63-4cef-967a-e5dceb53ef05', '4db325c5-4f87-4550-bd88-df5a13c1d83a', '8bf05a8c-8a98-4374-bd3d-7b14d2d1a9e7', '8442c03b-4a16-4f1e-a6fd-53a66805b6d2'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:28:59 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Delete snapshot completed successfully. Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4424b62a-a41e-4275-b1f5-7ebfef038fd3 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-64cb71ec-edfa-40be-aea0-8dc3b4336699-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:28:59 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2" returned: 0 in 0.410s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-65f6bb39-2a04-4c32-84d5-cbe8e051a75a-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:59 devstack sudo[90768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.info Apr 22 09:28:59 devstack sudo[90768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-65f6bb39-2a04-4c32-84d5-cbe8e051a75a-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-quobyte-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ef6cbf-36c1-4b7e-8176-5e5c79c683e3]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:59 devstack sudo[90770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a Apr 22 09:28:59 devstack sudo[90770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:59 devstack sudo[90768]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.info" returned: 0 in 0.417s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:59 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.info is being set with open permissions: ugo+rw Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:59 devstack sudo[90773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.info Apr 22 09:28:59 devstack sudo[90773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:59 devstack sudo[90770]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" returned: 0 in 0.463s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:28:59 devstack sudo[90778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a Apr 22 09:28:59 devstack sudo[90778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:28:59 devstack sudo[90773]: pam_unix(sudo:session): session closed for user root Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.info" returned: 0 in 0.421s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:28:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.690s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:28:59 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-68c156bf-cc15-4588-804d-4442afe2484b tempest-CinderUnicodeTest-805609501 None] Create snapshot completed successfully Apr 22 09:29:00 devstack sudo[90778]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" returned: 0 in 0.400s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-65f6bb39-2a04-4c32-84d5-cbe8e051a75a" released by "delete_volume" :: held 0.892s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Created reservations ['8b54449f-a7c1-4e67-b68b-2d14764b6fb6', 'df64a984-8a89-45fa-a3c5-ae5eeb62abda', '33c5f586-7833-4055-b185-bd92e49a21be', '0f4ae4e9-5681-4f57-b30e-ac5e79bec169'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:00 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:29:00 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Acquiring lock "cinder-8baefca5-a48d-48cb-8f41-25ec8ace8ce2-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Lock "cinder-8baefca5-a48d-48cb-8f41-25ec8ace8ce2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Acquiring lock "cinder-quobyte-08f0c95f-3813-41b1-9f11-132af2a13336" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Lock "cinder-quobyte-08f0c95f-3813-41b1-9f11-132af2a13336" acquired by "delete_snapshot" :: waited 0.027s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Acquiring lock "cinder-quobyte-8baefca5-a48d-48cb-8f41-25ec8ace8ce2" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Flow 'volume_create_manager' (510999e1-4e9b-421a-83d1-e25eb7e0ea0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd462a8-1d1b-4f86-9722-daa0db6d6d75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Lock "cinder-quobyte-8baefca5-a48d-48cb-8f41-25ec8ace8ce2" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Deleting offline snapshot 8baefca5-a48d-48cb-8f41-25ec8ace8ce2 of volume 08f0c95f-3813-41b1-9f11-132af2a13336 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] snapshot_file for this snap is: volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbd462a8-1d1b-4f86-9722-daa0db6d6d75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1711775830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4763a4c5-41e9-4aa3-b737-847c10c48ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c42271030d2475e8debd550d351326f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:00Z,use_quota=True,user_id='fe903446841b4752adcaa9bfccb624e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4535ef66-80bb-4789-818e-4993775a7249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4535ef66-80bb-4789-818e-4993775a7249) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a6ab39-a778-43b0-94da-a8abd2145e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1a6ab39-a778-43b0-94da-a8abd2145e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4763a4c5-41e9-4aa3-b737-847c10c48ddd', 'volume_name': 'volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950549cc-4e3f-47ce-8c37-a91f166c4d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950549cc-4e3f-47ce-8c37-a91f166c4d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668bc1f1-2b2c-4419-8d39-e595db4f3c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:00 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Volume 4763a4c5-41e9-4aa3-b737-847c10c48ddd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd', 'volume_size': 1} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1711775830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4763a4c5-41e9-4aa3-b737-847c10c48ddd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c42271030d2475e8debd550d351326f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:00Z,use_quota=True,user_id='fe903446841b4752adcaa9bfccb624e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Creating volume 4763a4c5-41e9-4aa3-b737-847c10c48ddd {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:00 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:29:00 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18d9a3c-0bba-416e-a2dc-851498623b24]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.460s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:00 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd 1073741824 Apr 22 09:29:00 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:29:00 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Deleted volume successfully. Apr 22 09:29:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-d15440be-8803-47c4-9921-cb5a30cde1f4 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-65f6bb39-2a04-4c32-84d5-cbe8e051a75a-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:00 devstack sudo[90786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 Apr 22 09:29:00 devstack sudo[90786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:01 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd 1073741824" returned: 0 in 0.489s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:01 devstack sudo[90786]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2" returned: 0 in 0.488s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08f0c95f-3813-41b1-9f11-132af2a13336(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9fe2ae-f569-4b29-9f60-ca1152d0587a]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:01 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd Apr 22 09:29:01 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:01 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 Apr 22 09:29:01 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:01 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd" returned: 0 in 0.426s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (668bc1f1-2b2c-4419-8d39-e595db4f3c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bbc27d-7177-4630-acbf-acaa475b7445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:01 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Volume volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd (4763a4c5-41e9-4aa3-b737-847c10c48ddd): created successfully Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2bbc27d-7177-4630-acbf-acaa475b7445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Flow 'volume_create_manager' (510999e1-4e9b-421a-83d1-e25eb7e0ea0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:01 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336" returned: 0 in 0.479s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:01 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-fe245f57-4932-436a-8cb4-9687e9cfc39f tempest-VolumeDependencyTests-713939473 None] Created volume successfully. Apr 22 09:29:01 devstack sudo[90804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 Apr 22 09:29:01 devstack sudo[90804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:02 devstack sudo[90804]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2" returned: 0 in 0.474s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:02 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2 Apr 22 09:29:02 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:02 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336.8baefca5-a48d-48cb-8f41-25ec8ace8ce2" returned: 0 in 0.408s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Lock "cinder-quobyte-8baefca5-a48d-48cb-8f41-25ec8ace8ce2" released by "_delete_snapshot" :: held 1.952s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Lock "cinder-quobyte-08f0c95f-3813-41b1-9f11-132af2a13336" released by "delete_snapshot" :: held 1.997s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Created reservations ['daf4816d-3bcc-4a82-af67-cec70e3ac733', '9a58d4ac-0394-43d7-983b-1fdd2de911ef', 'ecbbd7dc-60a8-45a9-9974-79ac1bcf25f2', '1742c980-790c-4728-9021-6b258ad70f74'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:02 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Delete snapshot completed successfully. Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-3d17a025-77c2-4119-9cbb-a8ce340b51d7 tempest-CinderUnicodeTest-805609501 None] Lock "cinder-8baefca5-a48d-48cb-8f41-25ec8ace8ce2-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Flow 'volume_create_manager' (ed29b578-3693-459c-a6a0-58a7ae1d68d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b687b62b-e7ba-49e1-938c-840985be7c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b687b62b-e7ba-49e1-938c-840985be7c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1476592263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=755a4b65-0258-44f0-83a6-9a641b008874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c42271030d2475e8debd550d351326f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4763a4c5-41e9-4aa3-b737-847c10c48ddd,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:03Z,use_quota=True,user_id='fe903446841b4752adcaa9bfccb624e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52900561-0824-4b42-b027-9307e2bb8ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52900561-0824-4b42-b027-9307e2bb8ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86c9fe8-9759-477a-95ab-8bdcbbfdd6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86c9fe8-9759-477a-95ab-8bdcbbfdd6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '755a4b65-0258-44f0-83a6-9a641b008874', 'volume_name': 'volume-755a4b65-0258-44f0-83a6-9a641b008874', 'volume_size': 1, 'source_volid': '4763a4c5-41e9-4aa3-b737-847c10c48ddd', 'source_volstatus': 'available'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022e8266-09f5-43fb-a4e3-1c285cb5f64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (022e8266-09f5-43fb-a4e3-1c285cb5f64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16310c5a-705f-4ae3-9009-db594f955f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:02 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Volume 755a4b65-0258-44f0-83a6-9a641b008874: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-755a4b65-0258-44f0-83a6-9a641b008874', 'volume_size': 1, 'source_volid': '4763a4c5-41e9-4aa3-b737-847c10c48ddd', 'source_volstatus': 'available'} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:02 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Cloning volume 4763a4c5-41e9-4aa3-b737-847c10c48ddd to volume 755a4b65-0258-44f0-83a6-9a641b008874 Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Creating offline snapshot 51330d76-63e4-43eb-b5f2-088e11e04951 of volume 4763a4c5-41e9-4aa3-b737-847c10c48ddd {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d2b154-9906-416e-b292-0e499789e0ec]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:03 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd Apr 22 09:29:03 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:03 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd" returned: 0 in 0.452s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:03 devstack sudo[90817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 1G Apr 22 09:29:03 devstack sudo[90817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Acquiring lock "cinder-08f0c95f-3813-41b1-9f11-132af2a13336-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Lock "cinder-08f0c95f-3813-41b1-9f11-132af2a13336-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Acquiring lock "cinder-quobyte-08f0c95f-3813-41b1-9f11-132af2a13336" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Lock "cinder-quobyte-08f0c95f-3813-41b1-9f11-132af2a13336" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:03 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2d24bd-038f-485c-ae1a-9d0ad7a6de3d]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:03 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 Apr 22 09:29:03 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:03 devstack sudo[90817]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 1G" returned: 0 in 0.492s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:03 devstack sudo[90824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 Apr 22 09:29:03 devstack sudo[90824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:04 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336" returned: 0 in 0.479s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:04 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336 Apr 22 09:29:04 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:04 devstack sudo[90824]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951" returned: 0 in 0.424s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:04 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 is being set with open permissions: ugo+rw Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:04 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 Apr 22 09:29:04 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:04 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-08f0c95f-3813-41b1-9f11-132af2a13336" returned: 0 in 0.412s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Lock "cinder-quobyte-08f0c95f-3813-41b1-9f11-132af2a13336" released by "delete_volume" :: held 0.928s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Created reservations ['313a3a24-1f08-4691-b21e-378d2eebd8db', '2ef6a5fe-db16-4881-bd7a-a00f84e71909', 'c8b20379-fe8d-4eaf-9f7f-93496f37e993', 'f2ca9a35-edbb-4314-b6c7-c8ece5a0a513'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:04 devstack sudo[90837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:29:04 devstack sudo[90837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Acquiring lock "cinder-66766fa7-1135-4a2c-a16a-b6af92a7a67b-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:04 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951" returned: 0 in 0.400s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Lock "cinder-66766fa7-1135-4a2c-a16a-b6af92a7a67b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:04 devstack sudo[90840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.info Apr 22 09:29:04 devstack sudo[90840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Acquiring lock "cinder-quobyte-66766fa7-1135-4a2c-a16a-b6af92a7a67b" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Lock "cinder-quobyte-66766fa7-1135-4a2c-a16a-b6af92a7a67b" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2d2c74-67da-4a75-a484-694819c97e08]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:04 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b Apr 22 09:29:04 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:05 devstack sudo[90837]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.494s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:29:05 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Deleted volume successfully. Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e229eadc-11f0-447c-9c1c-e1c06a5536f0 tempest-CinderUnicodeTest-805609501 None] Lock "cinder-08f0c95f-3813-41b1-9f11-132af2a13336-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:05 devstack sudo[90840]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.info" returned: 0 in 0.412s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:05 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.info is being set with open permissions: ugo+rw Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:05 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.info Apr 22 09:29:05 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:05 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b" returned: 0 in 0.509s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:05 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b Apr 22 09:29:05 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:05 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.info" returned: 0 in 0.414s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-quobyte-755a4b65-0258-44f0-83a6-9a641b008874" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-755a4b65-0258-44f0-83a6-9a641b008874" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] snapshot: 51330d76-63e4-43eb-b5f2-088e11e04951, volume: 755a4b65-0258-44f0-83a6-9a641b008874, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[08327887-0ca5-4f2b-938f-f6fe2c6468f3]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:05 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 Apr 22 09:29:05 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:05 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-66766fa7-1135-4a2c-a16a-b6af92a7a67b" returned: 0 in 0.395s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Lock "cinder-quobyte-66766fa7-1135-4a2c-a16a-b6af92a7a67b" released by "delete_volume" :: held 0.925s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Created reservations ['a6ff5066-3738-44ba-9fe6-46aa61657a32', '59f73664-e97f-4820-a124-2d555ac1c2c5', '7490cd63-4164-4afb-8f88-2cd86effc5a2', 'e48e6322-2448-4bc3-83ef-f2a594c62edc'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:05 devstack sudo[90857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:29:05 devstack sudo[90857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:06 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951" returned: 0 in 0.537s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0102516-5f2a-435f-b764-454df72916e2]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:06 devstack sudo[90857]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.462s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:29:06 devstack sudo[90863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd Apr 22 09:29:06 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:06 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Deleted volume successfully. Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-7c8f7418-af1c-4732-b993-6f3f433a685a tempest-CinderUnicodeTest-805609501 None] Lock "cinder-66766fa7-1135-4a2c-a16a-b6af92a7a67b-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:06 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd" returned: 0 in 0.535s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874 not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:29:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:06 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874 Apr 22 09:29:06 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:08 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874" returned: 0 in 2.096s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:08 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[24222ff0-7efc-496e-964a-1105aae2c31c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:08 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd Apr 22 09:29:08 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:09 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd" returned: 0 in 0.637s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:09 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd, size 1024.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874 {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:29:09 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Converted 1024.00 MB image at 488.32 MB/s Apr 22 09:29:09 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874 is being set with open permissions: ugo+rw Apr 22 09:29:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:09 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874 Apr 22 09:29:09 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:09 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874" returned: 0 in 0.450s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-755a4b65-0258-44f0-83a6-9a641b008874" released by "_copy_volume_from_snapshot" :: held 4.312s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-quobyte-51330d76-63e4-43eb-b5f2-088e11e04951" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-51330d76-63e4-43eb-b5f2-088e11e04951" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Deleting offline snapshot 51330d76-63e4-43eb-b5f2-088e11e04951 of volume 4763a4c5-41e9-4aa3-b737-847c10c48ddd {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:29:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] snapshot_file for this snap is: volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:29:09 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b410eee4-f99d-42b2-917c-ca87fa44d4d0]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:10 devstack sudo[90888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 Apr 22 09:29:10 devstack sudo[90888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:10 devstack sudo[90888]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951" returned: 0 in 0.527s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:10 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:29:10 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[734b70de-05cc-4f8b-8808-e6b414408688]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:10 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd Apr 22 09:29:10 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:10 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd" returned: 0 in 0.503s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:11 devstack sudo[90898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 Apr 22 09:29:11 devstack sudo[90898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:11 devstack sudo[90898]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951" returned: 0 in 0.532s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:11 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951 Apr 22 09:29:11 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:11 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd.51330d76-63e4-43eb-b5f2-088e11e04951" returned: 0 in 0.435s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-51330d76-63e4-43eb-b5f2-088e11e04951" released by "_delete_snapshot" :: held 2.045s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.082s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16310c5a-705f-4ae3-9009-db594f955f88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-755a4b65-0258-44f0-83a6-9a641b008874', 'volume_size': 1, 'source_volid': '4763a4c5-41e9-4aa3-b737-847c10c48ddd', 'source_volstatus': 'available'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a2def2-892d-4454-a878-1e5d91f7b699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:12 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Volume volume-755a4b65-0258-44f0-83a6-9a641b008874 (755a4b65-0258-44f0-83a6-9a641b008874): created successfully Apr 22 09:29:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85a2def2-892d-4454-a878-1e5d91f7b699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Flow 'volume_create_manager' (ed29b578-3693-459c-a6a0-58a7ae1d68d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:12 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-07311e28-636a-4e0a-9d07-afc99e6a454f tempest-VolumeDependencyTests-713939473 None] Created volume successfully. Apr 22 09:29:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-4763a4c5-41e9-4aa3-b737-847c10c48ddd-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Lock "cinder-4763a4c5-41e9-4aa3-b737-847c10c48ddd-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-quobyte-4763a4c5-41e9-4aa3-b737-847c10c48ddd" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-4763a4c5-41e9-4aa3-b737-847c10c48ddd" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:12 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e8b4af-4153-4ff9-98e0-8416460da04f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:12 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd Apr 22 09:29:12 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:13 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd" returned: 0 in 0.531s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:13 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd Apr 22 09:29:13 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:13 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-4763a4c5-41e9-4aa3-b737-847c10c48ddd" returned: 0 in 0.410s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-4763a4c5-41e9-4aa3-b737-847c10c48ddd" released by "delete_volume" :: held 0.978s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:13 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Created reservations ['7b1ce155-4a0f-4ed4-8395-835ee53f91ff', '23dfdcda-2cd0-41f6-92f0-ca8d14384700', 'e37dd214-6266-4e0f-a6e9-aa6336434cfe', 'e2b4fd89-c54a-457c-a8cc-add41b5d69fd'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:13 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:29:13 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:14 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.455s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:14 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:29:14 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Deleted volume successfully. Apr 22 09:29:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-03f79928-4fe8-41f2-ac92-001ec0a7084e tempest-VolumeDependencyTests-713939473 None] Lock "cinder-4763a4c5-41e9-4aa3-b737-847c10c48ddd-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-755a4b65-0258-44f0-83a6-9a641b008874-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-755a4b65-0258-44f0-83a6-9a641b008874-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-quobyte-755a4b65-0258-44f0-83a6-9a641b008874" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-755a4b65-0258-44f0-83a6-9a641b008874" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:14 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7249a3f0-bee6-4e35-af22-c59058f265ae]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:14 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874 Apr 22 09:29:14 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:15 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874" returned: 0 in 0.530s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:15 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874 Apr 22 09:29:15 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:15 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-755a4b65-0258-44f0-83a6-9a641b008874" returned: 0 in 0.455s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-755a4b65-0258-44f0-83a6-9a641b008874" released by "delete_volume" :: held 1.010s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:15 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Created reservations ['f2313faa-18bd-4c19-b97d-81f251369b18', '69b60e87-6aa8-4dad-93b4-a38ae1e0d66b', '2e97ee50-5416-4d6a-9343-69c0ef4df09d', '59a1b16d-72f5-4288-8fbe-406e980864f1'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:15 devstack sudo[90928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:29:15 devstack sudo[90928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:16 devstack sudo[90928]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.468s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:16 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:29:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Deleted volume successfully. Apr 22 09:29:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c284108-5c9f-4a60-8b61-cd9e9e5e0e77 tempest-VolumeDependencyTests-713939473 None] Lock "cinder-755a4b65-0258-44f0-83a6-9a641b008874-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Lock "cinder-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Acquiring lock "cinder-quobyte-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" acquired by "delete_volume" :: waited 0.024s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:16 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36b4e73-4322-4d1b-a3f8-c59a82b16d15]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:16 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 Apr 22 09:29:16 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:17 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" returned: 0 in 0.504s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:17 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7 Apr 22 09:29:17 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:17 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" returned: 0 in 0.502s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Lock "cinder-quobyte-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7" released by "delete_volume" :: held 1.036s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:17 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Created reservations ['9f6645b5-893a-4707-90b8-a91f16a4d6d0', 'b3f4ff1e-3e3a-4a84-ab22-0095e772e533', 'a0ac0b09-cb42-4bd3-9d33-94ed07017e51', 'ede16552-61d2-4eed-a30d-96d65e1d3c8c'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:18 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:29:18 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:18 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.487s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:18 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:29:18 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Deleted volume successfully. Apr 22 09:29:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-5d10f800-b5ea-45fe-ade2-cf08a6db615b tempest-VolumeDependencyTests-713939473 None] Lock "cinder-15ce3ac0-32ad-43f3-98b5-a8ba7ce6c6c7-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Flow 'volume_create_manager' (ddb7e710-571b-4324-9256-2bec18407a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce96f877-84fa-44f5-84de-3c63c5020ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce96f877-84fa-44f5-84de-3c63c5020ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2076328559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032dd58d-7692-41f9-96b7-96e6d3d24010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2c2857246042b7b40f7c039b18c490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:23Z,use_quota=True,user_id='a3335b51f35840b29ef333e708ef03cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae09c65-5858-4180-b790-c53419e987c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ae09c65-5858-4180-b790-c53419e987c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066e9aa6-827d-4779-b96b-50590af8f74f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066e9aa6-827d-4779-b96b-50590af8f74f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '032dd58d-7692-41f9-96b7-96e6d3d24010', 'volume_name': 'volume-032dd58d-7692-41f9-96b7-96e6d3d24010', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a983bc-7f97-4d75-af21-67c98a9fbfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49a983bc-7f97-4d75-af21-67c98a9fbfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e20ddd-8412-4c1c-8890-541c627a4d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:22 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Volume 032dd58d-7692-41f9-96b7-96e6d3d24010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-032dd58d-7692-41f9-96b7-96e6d3d24010', 'volume_size': 1} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2076328559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=032dd58d-7692-41f9-96b7-96e6d3d24010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2c2857246042b7b40f7c039b18c490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:23Z,use_quota=True,user_id='a3335b51f35840b29ef333e708ef03cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Creating volume 032dd58d-7692-41f9-96b7-96e6d3d24010 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:29:22 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:29:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:22 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 1073741824 Apr 22 09:29:22 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:23 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 1073741824" returned: 0 in 0.483s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:23 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 Apr 22 09:29:23 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:23 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010" returned: 0 in 0.426s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:29:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87e20ddd-8412-4c1c-8890-541c627a4d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-032dd58d-7692-41f9-96b7-96e6d3d24010', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc5ac54-6b63-4359-beb7-039bd99d469b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:23 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Volume volume-032dd58d-7692-41f9-96b7-96e6d3d24010 (032dd58d-7692-41f9-96b7-96e6d3d24010): created successfully Apr 22 09:29:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bc5ac54-6b63-4359-beb7-039bd99d469b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:23 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Flow 'volume_create_manager' (ddb7e710-571b-4324-9256-2bec18407a5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:23 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-9d6ecb47-adc7-4cb7-b9b5-c9781f5e67b8 tempest-SnapshotDependencyTests-592766709 None] Created volume successfully. Apr 22 09:29:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:24 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] Creating offline snapshot e3d6667f-b836-49c8-80d5-6286060244b5 of volume 032dd58d-7692-41f9-96b7-96e6d3d24010 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:29:24 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b60a14b-d86d-4837-8d6f-9ba9dccbb3cb]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:25 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 Apr 22 09:29:25 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:25 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010" returned: 0 in 0.490s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:25 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 1G Apr 22 09:29:25 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:25 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 1G" returned: 0 in 0.455s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-032dd58d-7692-41f9-96b7-96e6d3d24010 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:25 devstack sudo[90962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-032dd58d-7692-41f9-96b7-96e6d3d24010 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 Apr 22 09:29:25 devstack sudo[90962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:26 devstack sudo[90962]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-032dd58d-7692-41f9-96b7-96e6d3d24010 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5" returned: 0 in 0.419s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:26 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 is being set with open permissions: ugo+rw Apr 22 09:29:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:26 devstack sudo[90967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 Apr 22 09:29:26 devstack sudo[90967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:26 devstack sudo[90967]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5" returned: 0 in 0.409s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:26 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.info Apr 22 09:29:26 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:27 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.info" returned: 0 in 0.407s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:27 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.info is being set with open permissions: ugo+rw Apr 22 09:29:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:27 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.info Apr 22 09:29:27 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:27 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.info" returned: 0 in 0.409s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.648s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:27 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6094af81-93c9-44b4-bd1e-3ee36c829d0f tempest-SnapshotDependencyTests-592766709 None] Create snapshot completed successfully Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Flow 'volume_create_manager' (0a927a0b-9177-49b8-80e4-9eaa9716af03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483d4249-d5a1-4874-a1a3-c2ed3bcfcc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (483d4249-d5a1-4874-a1a3-c2ed3bcfcc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7607e753-ea02-46d7-b772-e466d5cccd4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf2c2857246042b7b40f7c039b18c490',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e3d6667f-b836-49c8-80d5-6286060244b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:28Z,use_quota=True,user_id='a3335b51f35840b29ef333e708ef03cd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42dbd24-82d6-4192-95e7-c7c8bc567ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b42dbd24-82d6-4192-95e7-c7c8bc567ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314c34d3-63a4-49c8-977f-ef30093cc2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (314c34d3-63a4-49c8-977f-ef30093cc2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7607e753-ea02-46d7-b772-e466d5cccd4b', 'volume_name': 'volume-7607e753-ea02-46d7-b772-e466d5cccd4b', 'volume_size': 1, 'snapshot_id': 'e3d6667f-b836-49c8-80d5-6286060244b5'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2cdb62-4aa3-47ed-9477-350204a5e63c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2cdb62-4aa3-47ed-9477-350204a5e63c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed494cd-db26-44fc-8f1c-9acb2d105910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:28 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Volume 7607e753-ea02-46d7-b772-e466d5cccd4b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7607e753-ea02-46d7-b772-e466d5cccd4b', 'volume_size': 1, 'snapshot_id': 'e3d6667f-b836-49c8-80d5-6286060244b5'} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "cinder-quobyte-e3d6667f-b836-49c8-80d5-6286060244b5-7607e753-ea02-46d7-b772-e466d5cccd4b" by "_create_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-e3d6667f-b836-49c8-80d5-6286060244b5-7607e753-ea02-46d7-b772-e466d5cccd4b" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Creating volume 7607e753-ea02-46d7-b772-e466d5cccd4b from snapshot e3d6667f-b836-49c8-80d5-6286060244b5 {{(pid=82642) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "cinder-quobyte-7607e753-ea02-46d7-b772-e466d5cccd4b" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-7607e753-ea02-46d7-b772-e466d5cccd4b" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] snapshot: e3d6667f-b836-49c8-80d5-6286060244b5, volume: 7607e753-ea02-46d7-b772-e466d5cccd4b, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfba6499-21ca-4362-83d6-897fdf89d397]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:28 devstack sudo[90976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 Apr 22 09:29:28 devstack sudo[90976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:28 devstack sudo[90976]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5" returned: 0 in 0.478s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-032dd58d-7692-41f9-96b7-96e6d3d24010(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb12d635-35ea-4a50-8f33-b9f1270d13fb]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:28 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 Apr 22 09:29:28 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:29 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010" returned: 0 in 0.464s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:29 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:29:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:29 devstack sudo[90987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b Apr 22 09:29:29 devstack sudo[90987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:30 devstack cinder-volume[82642]: DEBUG oslo_service.periodic_task [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:29:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:30 devstack sudo[90999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:29:30 devstack sudo[90999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:31 devstack sudo[90987]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b" returned: 0 in 1.943s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:31 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d23744-4a1c-46df-beef-b43fac16ddba]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:31 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 Apr 22 09:29:31 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:31 devstack sudo[90999]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.840s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:31 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:29:31 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010" returned: 0 in 0.610s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:31 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010, size 1024.00 MB, duration 1.94 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:29:31 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Converted 1024.00 MB image at 526.77 MB/s Apr 22 09:29:31 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b is being set with open permissions: ugo+rw Apr 22 09:29:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:31 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b Apr 22 09:29:31 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:32 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b" returned: 0 in 0.395s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-7607e753-ea02-46d7-b772-e466d5cccd4b" released by "_copy_volume_from_snapshot" :: held 3.943s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-e3d6667f-b836-49c8-80d5-6286060244b5-7607e753-ea02-46d7-b772-e466d5cccd4b" released by "_create_volume_from_snapshot" :: held 3.959s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.967s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:INSERT=26,cinder:SELECT=88,cinder:UPDATE=131,cinder:DELETE=9 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eed494cd-db26-44fc-8f1c-9acb2d105910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7607e753-ea02-46d7-b772-e466d5cccd4b', 'volume_size': 1, 'snapshot_id': 'e3d6667f-b836-49c8-80d5-6286060244b5'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522f0586-d517-47e6-ba1e-72a52e93debd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:32 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Volume volume-7607e753-ea02-46d7-b772-e466d5cccd4b (7607e753-ea02-46d7-b772-e466d5cccd4b): created successfully Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522f0586-d517-47e6-ba1e-72a52e93debd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Flow 'volume_create_manager' (0a927a0b-9177-49b8-80e4-9eaa9716af03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:32 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ca4215d2-0eb9-4324-b7fe-9811245d9f5d tempest-SnapshotDependencyTests-592766709 None] Created volume successfully. Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "cinder-e3d6667f-b836-49c8-80d5-6286060244b5-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-e3d6667f-b836-49c8-80d5-6286060244b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "cinder-quobyte-032dd58d-7692-41f9-96b7-96e6d3d24010" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-032dd58d-7692-41f9-96b7-96e6d3d24010" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "cinder-quobyte-e3d6667f-b836-49c8-80d5-6286060244b5" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-e3d6667f-b836-49c8-80d5-6286060244b5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Deleting offline snapshot e3d6667f-b836-49c8-80d5-6286060244b5 of volume 032dd58d-7692-41f9-96b7-96e6d3d24010 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] snapshot_file for this snap is: volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[362a3f4b-3e66-476e-8dfd-9fffe8cb5494]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:32 devstack sudo[91017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 Apr 22 09:29:32 devstack sudo[91017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:33 devstack sudo[91017]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5" returned: 0 in 0.476s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:33 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-032dd58d-7692-41f9-96b7-96e6d3d24010(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:29:33 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98f0174-61a7-411d-9db9-26595499e1da]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:33 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 Apr 22 09:29:33 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:33 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010" returned: 0 in 0.481s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:33 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 Apr 22 09:29:33 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:34 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5" returned: 0 in 0.455s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:34 devstack sudo[91032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5 Apr 22 09:29:34 devstack sudo[91032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:34 devstack sudo[91032]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010.e3d6667f-b836-49c8-80d5-6286060244b5" returned: 0 in 0.394s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-e3d6667f-b836-49c8-80d5-6286060244b5" released by "_delete_snapshot" :: held 1.858s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-032dd58d-7692-41f9-96b7-96e6d3d24010" released by "delete_snapshot" :: held 1.870s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Created reservations ['7b35e67d-44e9-4916-8c05-6adf027892ce', '78d6a762-bf17-4c15-b42e-abd15cf7e475', 'a03c9533-e079-45bf-a1e4-9de7721e462d', '324fd891-a504-46f5-a1bd-46842ae0bdda'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:34 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Delete snapshot completed successfully. Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-92bdbf75-61a8-4881-9bba-6fdd64a8d82d tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-e3d6667f-b836-49c8-80d5-6286060244b5-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "cinder-032dd58d-7692-41f9-96b7-96e6d3d24010-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-032dd58d-7692-41f9-96b7-96e6d3d24010-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "cinder-quobyte-032dd58d-7692-41f9-96b7-96e6d3d24010" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-032dd58d-7692-41f9-96b7-96e6d3d24010" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ab01ca-ec88-4bd4-8ed8-48244e37061f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:34 devstack sudo[91035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 Apr 22 09:29:34 devstack sudo[91035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:35 devstack sudo[91035]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010" returned: 0 in 0.463s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:35 devstack sudo[91040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010 Apr 22 09:29:35 devstack sudo[91040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:35 devstack sudo[91040]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-032dd58d-7692-41f9-96b7-96e6d3d24010" returned: 0 in 0.408s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-032dd58d-7692-41f9-96b7-96e6d3d24010" released by "delete_volume" :: held 0.900s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:UPDATE=104,cinder:DELETE=13,cinder:SELECT=103,cinder:INSERT=35 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Created reservations ['6cf76304-12d6-4b28-87fa-64f63ebfc976', '92a6685b-f0f8-4ea5-b045-34d0373052be', '5bdf2bc7-7593-451e-bcad-4af6272bb24b', '231e3c64-b11f-47e1-9fcd-da675ba87873'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:35 devstack sudo[91043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:29:35 devstack sudo[91043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "cinder-7607e753-ea02-46d7-b772-e466d5cccd4b-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-7607e753-ea02-46d7-b772-e466d5cccd4b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "cinder-quobyte-7607e753-ea02-46d7-b772-e466d5cccd4b" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-7607e753-ea02-46d7-b772-e466d5cccd4b" acquired by "delete_volume" :: waited 0.006s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[21056e18-357b-4df6-9b41-57b4e03dfead]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:36 devstack sudo[91045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b Apr 22 09:29:36 devstack sudo[91045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:36 devstack sudo[91043]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.430s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:29:36 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Deleted volume successfully. Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-0c167a18-1739-49dd-9334-3ad3cac4003b tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-032dd58d-7692-41f9-96b7-96e6d3d24010-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:36 devstack sudo[91045]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b" returned: 0 in 0.473s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:36 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b Apr 22 09:29:36 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:36 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-7607e753-ea02-46d7-b772-e466d5cccd4b" returned: 0 in 0.398s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-quobyte-7607e753-ea02-46d7-b772-e466d5cccd4b" released by "delete_volume" :: held 0.893s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Created reservations ['0fe1fe99-e48c-47a8-bc3d-c4397f7aecad', '8283a738-15ed-4a89-b74e-aa4233ed2e8c', 'aa53f163-2294-43af-a2a0-3acc49c742ec', '2c86d4c6-e6bb-4146-bc68-2edb744931cd'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:36 devstack sudo[91054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:29:36 devstack sudo[91054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:37 devstack sudo[91054]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.428s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:37 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:29:37 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Deleted volume successfully. Apr 22 09:29:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8ed5597a-9518-49e1-b8f7-799bba0847e8 tempest-SnapshotDependencyTests-592766709 None] Lock "cinder-7607e753-ea02-46d7-b772-e466d5cccd4b-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:46 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:UPDATE=21,cinder:SELECT=18,cinder:INSERT=8,cinder:DELETE=1 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:29:47 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:UPDATE=17,cinder:SELECT=7,cinder:INSERT=2,cinder:DELETE=1 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Flow 'volume_create_manager' (0b599ccf-e902-4ecd-be35-3d37010cdb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7579f7f-d2ce-4ddb-bf17-465c2f3e16eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7579f7f-d2ce-4ddb-bf17-465c2f3e16eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-649909878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f25395-99ec-4f0b-acf6-b6898113f5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7daff91942147beb523fc9ba54c2e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='40a176eecf6e494382804d1a749d4131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545d2889-862e-4938-9bcb-d94e153088fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545d2889-862e-4938-9bcb-d94e153088fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e42d3b-b7e4-4f7a-9b4f-abc7444c93ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e42d3b-b7e4-4f7a-9b4f-abc7444c93ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09f25395-99ec-4f0b-acf6-b6898113f5b8', 'volume_name': 'volume-09f25395-99ec-4f0b-acf6-b6898113f5b8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb0a515-bbee-403e-a07f-281a7cf9fd76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdb0a515-bbee-403e-a07f-281a7cf9fd76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1849e33-3389-494d-b323-3b55bc60f702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:48 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Volume 09f25395-99ec-4f0b-acf6-b6898113f5b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09f25395-99ec-4f0b-acf6-b6898113f5b8', 'volume_size': 1} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-649909878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09f25395-99ec-4f0b-acf6-b6898113f5b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7daff91942147beb523fc9ba54c2e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='40a176eecf6e494382804d1a749d4131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Creating volume 09f25395-99ec-4f0b-acf6-b6898113f5b8 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:29:48 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:48 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 1073741824 Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (ac67145e-6701-4414-b424-1ff3a268e4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0232587f-d2d9-4c58-ba94-fbda59a04ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:48 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0232587f-d2d9-4c58-ba94-fbda59a04ab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1926331568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5837038c-94be-4c68-9e09-da9fa4a5b69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5837038c-94be-4c68-9e09-da9fa4a5b69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ab17f8-a2fa-450a-93c4-aaf5654cd69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ab17f8-a2fa-450a-93c4-aaf5654cd69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b', 'volume_name': 'volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:48 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cee07b-86d4-4834-b4c4-ebd0149bca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cee07b-86d4-4834-b4c4-ebd0149bca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affdadc8-799e-4dab-b11a-1a73f7ad5733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume 6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b', 'volume_size': 1} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Flow 'volume_create_manager' (a10b17d8-8c24-4a68-908e-ab2d7e698bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221c8dea-b975-4e3a-a57a-35410f5864b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (221c8dea-b975-4e3a-a57a-35410f5864b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-789691461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a9b560-7065-4c82-b891-c72dee11dde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d62835690ef4d00b87e3fd95265d379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='7f5e357900a94462beb934dd9e10b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74cf609-37cc-4a0c-88f9-e500d26629bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e74cf609-37cc-4a0c-88f9-e500d26629bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d305bb-9cb5-4e80-a6d3-00b564792b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68d305bb-9cb5-4e80-a6d3-00b564792b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7a9b560-7065-4c82-b891-c72dee11dde1', 'volume_name': 'volume-d7a9b560-7065-4c82-b891-c72dee11dde1', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e908aa8e-1469-40b3-85ed-3be8b135f08d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e908aa8e-1469-40b3-85ed-3be8b135f08d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390c6c5d-64cb-433c-bbb1-c28c55051ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Volume d7a9b560-7065-4c82-b891-c72dee11dde1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7a9b560-7065-4c82-b891-c72dee11dde1', 'volume_size': 1} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (b05b4234-cc06-4d73-b95b-dfae748e5d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bef752-5ad3-4438-8a9b-acb615744357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bef752-5ad3-4438-8a9b-acb615744357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953908184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1933ce-591e-4676-8c39-92f1e87900a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfdac4c-1871-4b25-9563-728de4bdc3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfdac4c-1871-4b25-9563-728de4bdc3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7712bd-b4e6-4a9a-ab21-e66714f7b9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d7712bd-b4e6-4a9a-ab21-e66714f7b9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f1933ce-591e-4676-8c39-92f1e87900a8', 'volume_name': 'volume-9f1933ce-591e-4676-8c39-92f1e87900a8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d51a353-7c25-4af0-96fc-989bd91a2579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d51a353-7c25-4af0-96fc-989bd91a2579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52594f6-33d6-4610-b327-1ebacb3ccff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume 9f1933ce-591e-4676-8c39-92f1e87900a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f1933ce-591e-4676-8c39-92f1e87900a8', 'volume_size': 1} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Flow 'volume_create_manager' (919afc39-af26-4e8b-a617-970bae06219f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f1d1c1-1be0-43fd-b88c-0f5cf66aa509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7f1d1c1-1be0-43fd-b88c-0f5cf66aa509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146842057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda36daa-4d94-4f08-96ba-fa48786ee744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d62835690ef4d00b87e3fd95265d379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='7f5e357900a94462beb934dd9e10b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b7b614-27a2-4db9-a3f6-3d521edbebe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87b7b614-27a2-4db9-a3f6-3d521edbebe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adeaaea4-ca73-469e-9c69-8110c4920acd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adeaaea4-ca73-469e-9c69-8110c4920acd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda36daa-4d94-4f08-96ba-fa48786ee744', 'volume_name': 'volume-fda36daa-4d94-4f08-96ba-fa48786ee744', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2914c273-e0fe-4009-bcab-42aabe49b770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2914c273-e0fe-4009-bcab-42aabe49b770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338c08ea-1fa5-4644-9edc-0bf6730ef159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Volume fda36daa-4d94-4f08-96ba-fa48786ee744: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda36daa-4d94-4f08-96ba-fa48786ee744', 'volume_size': 1} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Flow 'volume_create_manager' (08f2ac30-b529-4bc6-87db-c87a4c2afadc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b07c8c-4ca3-4cae-ace9-7b85ad3c1031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b07c8c-4ca3-4cae-ace9-7b85ad3c1031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-672255300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e3851d-2b03-457a-b192-9191d66e0454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d62835690ef4d00b87e3fd95265d379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='7f5e357900a94462beb934dd9e10b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60206a8-44f7-4c6c-b9f6-9199d8a27baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b60206a8-44f7-4c6c-b9f6-9199d8a27baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab99b08-b7af-46b6-8d87-fe6d436da164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cab99b08-b7af-46b6-8d87-fe6d436da164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e3851d-2b03-457a-b192-9191d66e0454', 'volume_name': 'volume-20e3851d-2b03-457a-b192-9191d66e0454', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76465665-612b-4610-acd3-ed845740270a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76465665-612b-4610-acd3-ed845740270a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdc9c8-f6be-403c-85f6-abff82feb65e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Volume 20e3851d-2b03-457a-b192-9191d66e0454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e3851d-2b03-457a-b192-9191d66e0454', 'volume_size': 1} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:49 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 1073741824" returned: 0 in 0.627s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:49 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 Apr 22 09:29:49 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Flow 'volume_create_manager' (0e891bff-5a9e-4528-993d-7f460d7fd655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf0dc3b-e41b-44ae-9d54-f054aa9d559e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bf0dc3b-e41b-44ae-9d54-f054aa9d559e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-332086947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838fd898-666b-4a82-be5b-07461f72a998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d62835690ef4d00b87e3fd95265d379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:50Z,use_quota=True,user_id='7f5e357900a94462beb934dd9e10b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46cc2ba-ab97-4e23-aab4-e68645bac906) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46cc2ba-ab97-4e23-aab4-e68645bac906) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab345235-2d7f-4cd6-90cf-b2a4fabe6d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab345235-2d7f-4cd6-90cf-b2a4fabe6d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '838fd898-666b-4a82-be5b-07461f72a998', 'volume_name': 'volume-838fd898-666b-4a82-be5b-07461f72a998', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7889d1-8361-4cc0-b57b-0abdeff6a5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7889d1-8361-4cc0-b57b-0abdeff6a5eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4781fc3c-cbd6-4f9a-8936-e84884f97724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Volume 838fd898-666b-4a82-be5b-07461f72a998: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-838fd898-666b-4a82-be5b-07461f72a998', 'volume_size': 1} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Flow 'volume_create_manager' (eb8c5cb8-113f-4b7c-ba18-ba5dc6a4b31d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a78d575-58f6-41a9-9a9a-91ea2088432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a78d575-58f6-41a9-9a9a-91ea2088432f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1990862553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4909d8-aaaa-4a0d-8759-184b19fc1bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d62835690ef4d00b87e3fd95265d379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:50Z,use_quota=True,user_id='7f5e357900a94462beb934dd9e10b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03174807-cf11-4440-b765-18ac318b930f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03174807-cf11-4440-b765-18ac318b930f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ade2e07-4b1c-4a84-a0b2-dad56f0c679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ade2e07-4b1c-4a84-a0b2-dad56f0c679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e4909d8-aaaa-4a0d-8759-184b19fc1bbd', 'volume_name': 'volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82e3b64-b916-4679-8c6d-6fb4d464a495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d82e3b64-b916-4679-8c6d-6fb4d464a495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f558b66-47a1-4c1b-9bdd-6b35363f0e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:49 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Volume 2e4909d8-aaaa-4a0d-8759-184b19fc1bbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd', 'volume_size': 1} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:49 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8" returned: 0 in 0.442s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.974s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1926331568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Creating volume 6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:29:49 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:29:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1849e33-3389-494d-b323-3b55bc60f702) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09f25395-99ec-4f0b-acf6-b6898113f5b8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d156063-4c35-4637-aa26-c29e0e4399d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:50 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b 1073741824 Apr 22 09:29:50 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:50 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Volume volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 (09f25395-99ec-4f0b-acf6-b6898113f5b8): created successfully Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d156063-4c35-4637-aa26-c29e0e4399d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Flow 'volume_create_manager' (0b599ccf-e902-4ecd-be35-3d37010cdb8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:50 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-38d68b73-33de-433b-901d-769461871ad4 tempest-VolumeDependencyTests-1225167530 None] Created volume successfully. Apr 22 09:29:50 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b 1073741824" returned: 0 in 0.494s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:50 devstack sudo[91150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b Apr 22 09:29:50 devstack sudo[91150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:50 devstack sudo[91150]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b" returned: 0 in 0.415s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] <== create_volume: return (932ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.838s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-789691461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7a9b560-7065-4c82-b891-c72dee11dde1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d62835690ef4d00b87e3fd95265d379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='7f5e357900a94462beb934dd9e10b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Creating volume d7a9b560-7065-4c82-b891-c72dee11dde1 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:29:50 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affdadc8-799e-4dab-b11a-1a73f7ad5733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:50 devstack sudo[91153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1 1073741824 Apr 22 09:29:50 devstack sudo[91153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a37dc17-64b3-4dbe-b2ce-b7a1a392bb28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:50 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b (6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b): created successfully Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a37dc17-64b3-4dbe-b2ce-b7a1a392bb28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (ac67145e-6701-4414-b424-1ff3a268e4c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:50 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b27c5b9d-e117-4273-adeb-92de210ce9b4 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created volume successfully. Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:51 devstack sudo[91153]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1 1073741824" returned: 0 in 0.501s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:51 devstack sudo[91159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1 Apr 22 09:29:51 devstack sudo[91159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:51 devstack sudo[91159]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1" returned: 0 in 0.405s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.696s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1953908184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f1933ce-591e-4676-8c39-92f1e87900a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Creating volume 9f1933ce-591e-4676-8c39-92f1e87900a8 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:29:51 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390c6c5d-64cb-433c-bbb1-c28c55051ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7a9b560-7065-4c82-b891-c72dee11dde1', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:51 devstack sudo[91162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8 1073741824 Apr 22 09:29:51 devstack sudo[91162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc97ce58-0b81-4432-879e-0efd57838a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:51 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Volume volume-d7a9b560-7065-4c82-b891-c72dee11dde1 (d7a9b560-7065-4c82-b891-c72dee11dde1): created successfully Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc97ce58-0b81-4432-879e-0efd57838a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:51 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Flow 'volume_create_manager' (a10b17d8-8c24-4a68-908e-ab2d7e698bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:51 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-507913a3-afc6-4c0c-bb13-914bbd0e2bb8 tempest-CreateVolumesFromImageTest-859117189 None] Created volume successfully. Apr 22 09:29:52 devstack sudo[91162]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8 1073741824" returned: 0 in 0.516s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:52 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8 Apr 22 09:29:52 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:52 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8" returned: 0 in 0.399s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.549s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-146842057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda36daa-4d94-4f08-96ba-fa48786ee744,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d62835690ef4d00b87e3fd95265d379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='7f5e357900a94462beb934dd9e10b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Creating volume fda36daa-4d94-4f08-96ba-fa48786ee744 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:29:52 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c52594f6-33d6-4610-b327-1ebacb3ccff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f1933ce-591e-4676-8c39-92f1e87900a8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:52 devstack sudo[91170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744 1073741824 Apr 22 09:29:52 devstack sudo[91170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9ee1e7-fe7c-4f3f-921d-3938c06fdd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:52 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume volume-9f1933ce-591e-4676-8c39-92f1e87900a8 (9f1933ce-591e-4676-8c39-92f1e87900a8): created successfully Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac9ee1e7-fe7c-4f3f-921d-3938c06fdd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:52 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (b05b4234-cc06-4d73-b95b-dfae748e5d97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:52 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-78cbb2bc-ffc1-4a32-845b-b030e4461cf0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created volume successfully. Apr 22 09:29:53 devstack sudo[91170]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744 1073741824" returned: 0 in 0.481s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:53 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744 Apr 22 09:29:53 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (fe86c6bb-b61c-4d78-b493-47cdcf952cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1149bda5-a754-4bec-90ac-7ffbca2d36f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1149bda5-a754-4bec-90ac-7ffbca2d36f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974635158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65419830-37f0-4b3f-b858-9cc29b839f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:54Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6872eb6a-afe6-4229-96a2-043deda00d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6872eb6a-afe6-4229-96a2-043deda00d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb7cbe4-b25e-422c-8846-534ef7ca5195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb7cbe4-b25e-422c-8846-534ef7ca5195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65419830-37f0-4b3f-b858-9cc29b839f2c', 'volume_name': 'volume-65419830-37f0-4b3f-b858-9cc29b839f2c', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a72268-4074-458d-a2ed-4fac4fcb9990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9a72268-4074-458d-a2ed-4fac4fcb9990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf510ba-8bbb-46f3-bf0a-8868e462a45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:53 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume 65419830-37f0-4b3f-b858-9cc29b839f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65419830-37f0-4b3f-b858-9cc29b839f2c', 'volume_size': 1} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:53 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744" returned: 0 in 0.438s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.325s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-672255300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e3851d-2b03-457a-b192-9191d66e0454,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d62835690ef4d00b87e3fd95265d379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:49Z,use_quota=True,user_id='7f5e357900a94462beb934dd9e10b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Creating volume 20e3851d-2b03-457a-b192-9191d66e0454 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:29:53 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:53 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454 1073741824 Apr 22 09:29:53 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338c08ea-1fa5-4644-9edc-0bf6730ef159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda36daa-4d94-4f08-96ba-fa48786ee744', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4af0786-dfdb-4caa-83ad-0330149ce52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (f7a80fc9-d893-4d9a-a703-0aa63915ab95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca971fa-82c9-4e67-bf77-d41337dfcf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:53 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Volume volume-fda36daa-4d94-4f08-96ba-fa48786ee744 (fda36daa-4d94-4f08-96ba-fa48786ee744): created successfully Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4af0786-dfdb-4caa-83ad-0330149ce52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Flow 'volume_create_manager' (919afc39-af26-4e8b-a617-970bae06219f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:53 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c3d6857a-7833-41a8-b19d-5093a3ac157e tempest-CreateVolumesFromImageTest-859117189 None] Created volume successfully. Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ca971fa-82c9-4e67-bf77-d41337dfcf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392413115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8847df09-e605-475b-acb0-b17bffb65c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:54Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c63320-f8e2-4d66-9f7f-7463eef22ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79c63320-f8e2-4d66-9f7f-7463eef22ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b210e6-3425-47c5-8083-46b16f3487e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b210e6-3425-47c5-8083-46b16f3487e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8847df09-e605-475b-acb0-b17bffb65c65', 'volume_name': 'volume-8847df09-e605-475b-acb0-b17bffb65c65', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91000cae-0d1f-4cca-b661-bb1c7fba50a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91000cae-0d1f-4cca-b661-bb1c7fba50a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6225c43-5671-4be9-8551-e2eabf7e91fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:53 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume 8847df09-e605-475b-acb0-b17bffb65c65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8847df09-e605-475b-acb0-b17bffb65c65', 'volume_size': 1} Apr 22 09:29:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (4e559718-b1c3-48bb-b8fb-24d1017dd997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de8d5a0-a935-4daf-9940-569c3da254e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8de8d5a0-a935-4daf-9940-569c3da254e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319996590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455602c1-022d-4243-bdc8-b8514b38cfc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:54Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd1bdf9-da73-4075-8606-4051b7d34a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3dd1bdf9-da73-4075-8606-4051b7d34a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae9a217-3049-4d05-be37-f04d895c4dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ae9a217-3049-4d05-be37-f04d895c4dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '455602c1-022d-4243-bdc8-b8514b38cfc9', 'volume_name': 'volume-455602c1-022d-4243-bdc8-b8514b38cfc9', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85629dd-f75a-4543-a322-6da697c9513f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85629dd-f75a-4543-a322-6da697c9513f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deeb20d8-f760-4277-9942-b06cd46d83f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume 455602c1-022d-4243-bdc8-b8514b38cfc9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-455602c1-022d-4243-bdc8-b8514b38cfc9', 'volume_size': 1} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (2f78eda8-67dd-4e85-a445-f377258558b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d923287-3da7-47d4-9a72-eada85fdeda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d923287-3da7-47d4-9a72-eada85fdeda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752261974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee66bb06-e6fe-496d-a22d-d384e926e27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:54Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923fd5c0-b5cd-4ba5-9d6a-d351870f5fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923fd5c0-b5cd-4ba5-9d6a-d351870f5fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bbb8ba-ceff-4fc6-a72b-60796c5880e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91bbb8ba-ceff-4fc6-a72b-60796c5880e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee66bb06-e6fe-496d-a22d-d384e926e27e', 'volume_name': 'volume-ee66bb06-e6fe-496d-a22d-d384e926e27e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8015b1-3ad3-4510-8688-7676f7c6d33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d8015b1-3ad3-4510-8688-7676f7c6d33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372574fd-90b4-43f1-8871-7710d2048954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume ee66bb06-e6fe-496d-a22d-d384e926e27e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee66bb06-e6fe-496d-a22d-d384e926e27e', 'volume_size': 1} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:54 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454 1073741824" returned: 0 in 0.521s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:54 devstack sudo[91183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454 Apr 22 09:29:54 devstack sudo[91183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (1687890b-89ea-4b9d-a089-8791ffd371d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa0ee1e-4810-449b-8ff0-dde783099bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfa0ee1e-4810-449b-8ff0-dde783099bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-466968938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:54Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6cb77f-9945-4e5d-bee4-5cac74d0edb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f6cb77f-9945-4e5d-bee4-5cac74d0edb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e9e6a0-8af0-4525-9b73-a7f4f464c1e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1e9e6a0-8af0-4525-9b73-a7f4f464c1e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e', 'volume_name': 'volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e7b113-89da-4b26-ada6-35227b7145e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e7b113-89da-4b26-ada6-35227b7145e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ba372e-8fc5-4e5c-ae17-c64c22bca778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume 5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e', 'volume_size': 1} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:54 devstack sudo[91183]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454" returned: 0 in 0.421s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.125s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-332086947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=838fd898-666b-4a82-be5b-07461f72a998,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d62835690ef4d00b87e3fd95265d379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:50Z,use_quota=True,user_id='7f5e357900a94462beb934dd9e10b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Creating volume 838fd898-666b-4a82-be5b-07461f72a998 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:29:54 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57bdc9c8-f6be-403c-85f6-abff82feb65e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e3851d-2b03-457a-b192-9191d66e0454', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack sudo[91186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998 1073741824 Apr 22 09:29:54 devstack sudo[91186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15b9e6f-5886-4671-883c-7f457f845989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:54 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Volume volume-20e3851d-2b03-457a-b192-9191d66e0454 (20e3851d-2b03-457a-b192-9191d66e0454): created successfully Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a15b9e6f-5886-4671-883c-7f457f845989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:54 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Flow 'volume_create_manager' (08f2ac30-b529-4bc6-87db-c87a4c2afadc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:54 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-dcd69b32-36b9-4d79-b952-e13967c2a9a7 tempest-CreateVolumesFromImageTest-859117189 None] Created volume successfully. Apr 22 09:29:55 devstack sudo[91186]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998 1073741824" returned: 0 in 0.467s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:55 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998 Apr 22 09:29:55 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:55 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998" returned: 0 in 0.406s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.866s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1990862553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e4909d8-aaaa-4a0d-8759-184b19fc1bbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d62835690ef4d00b87e3fd95265d379',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:50Z,use_quota=True,user_id='7f5e357900a94462beb934dd9e10b371',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Creating volume 2e4909d8-aaaa-4a0d-8759-184b19fc1bbd {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:29:55 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4781fc3c-cbd6-4f9a-8936-e84884f97724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-838fd898-666b-4a82-be5b-07461f72a998', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:55 devstack sudo[91194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd 1073741824 Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522a1d0d-f0b5-46f2-9d76-3c7a38649077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:55 devstack sudo[91194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:55 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Volume volume-838fd898-666b-4a82-be5b-07461f72a998 (838fd898-666b-4a82-be5b-07461f72a998): created successfully Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (522a1d0d-f0b5-46f2-9d76-3c7a38649077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:55 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Flow 'volume_create_manager' (0e891bff-5a9e-4528-993d-7f460d7fd655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:55 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-66f03ead-7f2d-4281-a34f-4365e2af2916 tempest-CreateVolumesFromImageTest-859117189 None] Created volume successfully. Apr 22 09:29:56 devstack sudo[91194]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd 1073741824" returned: 0 in 0.480s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:56 devstack sudo[91199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd Apr 22 09:29:56 devstack sudo[91199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:56 devstack sudo[91199]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd" returned: 0 in 0.412s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.381s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] Creating offline snapshot a6f3d533-0b03-484b-8d37-80f0b304bfcc of volume 09f25395-99ec-4f0b-acf6-b6898113f5b8 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f558b66-47a1-4c1b-9bdd-6b35363f0e53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9331e52a-3785-438b-9628-6f76b1c82136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e71108-a471-469a-bb32-ef524346f0a0]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:56 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Volume volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd (2e4909d8-aaaa-4a0d-8759-184b19fc1bbd): created successfully Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9331e52a-3785-438b-9628-6f76b1c82136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:56 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Flow 'volume_create_manager' (eb8c5cb8-113f-4b7c-ba18-ba5dc6a4b31d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:56 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-3626ce26-5338-4c9a-9044-ebe3ae6f4add tempest-CreateVolumesFromImageTest-859117189 None] Created volume successfully. Apr 22 09:29:56 devstack sudo[91202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 Apr 22 09:29:56 devstack sudo[91202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:57 devstack sudo[91202]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8" returned: 0 in 0.466s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:57 devstack sudo[91207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc 1G Apr 22 09:29:57 devstack sudo[91207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "cinder-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "cinder-quobyte-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-quobyte-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd" acquired by "delete_volume" :: waited 0.006s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[005d6538-5b07-4a4f-96b3-fd8ea7055757]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:57 devstack sudo[91209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd Apr 22 09:29:57 devstack sudo[91209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:57 devstack sudo[91207]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc 1G" returned: 0 in 0.502s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:57 devstack sudo[91214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc Apr 22 09:29:57 devstack sudo[91214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:57 devstack sudo[91209]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd" returned: 0 in 0.479s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:57 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:57 devstack sudo[91219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd Apr 22 09:29:57 devstack sudo[91219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:58 devstack sudo[91214]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc" returned: 0 in 0.426s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:58 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc is being set with open permissions: ugo+rw Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:58 devstack sudo[91224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc Apr 22 09:29:58 devstack sudo[91224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:58 devstack sudo[91219]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd" returned: 0 in 0.404s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-quobyte-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd" released by "delete_volume" :: held 0.904s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Created reservations ['8381284b-347a-478f-9f95-12ffa46e88b5', 'a19db77c-fd1a-4ce6-b4bf-553c7b81ca93', '425d2b31-fe8a-4261-b157-336248f5682f', '752ecb7a-6bc7-47e8-83aa-659109fb2eb2'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:58 devstack sudo[91227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:29:58 devstack sudo[91227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "cinder-838fd898-666b-4a82-be5b-07461f72a998-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-838fd898-666b-4a82-be5b-07461f72a998-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "cinder-quobyte-838fd898-666b-4a82-be5b-07461f72a998" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-quobyte-838fd898-666b-4a82-be5b-07461f72a998" acquired by "delete_volume" :: waited 0.006s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f569dfe-89b9-40ce-8c74-8912fd789682]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:58 devstack sudo[91224]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc" returned: 0 in 0.453s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:58 devstack sudo[91231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.info Apr 22 09:29:58 devstack sudo[91231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:58 devstack sudo[91230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998 Apr 22 09:29:58 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:58 devstack sudo[91227]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.453s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:29:58 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Deleted volume successfully. Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-78ed0f8f-af75-4001-8059-0bdeb580ebc7 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-2e4909d8-aaaa-4a0d-8759-184b19fc1bbd-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:58 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998" returned: 0 in 0.467s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:58 devstack sudo[91231]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.info" returned: 0 in 0.446s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:58 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.info is being set with open permissions: ugo+rw Apr 22 09:29:58 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:58 devstack sudo[91239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998 Apr 22 09:29:58 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:58 devstack sudo[91241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.info Apr 22 09:29:58 devstack sudo[91241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:59 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-838fd898-666b-4a82-be5b-07461f72a998" returned: 0 in 0.412s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-quobyte-838fd898-666b-4a82-be5b-07461f72a998" released by "delete_volume" :: held 0.899s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:59 devstack sudo[91241]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.info" returned: 0 in 0.414s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.776s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.086s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:59 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b843bb46-01d6-45fa-b183-1b383a696ddb tempest-VolumeDependencyTests-1225167530 None] Create snapshot completed successfully Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Creating offline snapshot 5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 of volume 6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5718ca2-ff17-47a4-b4de-76942103e7a3]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Created reservations ['ece81815-513c-4ffa-94fa-be59198a860c', '253bbb95-dd66-486d-a1f4-051d39f873c1', 'e2fd0b0f-8bbd-4ec8-b737-bc26f5d5d836', '4a5f8bce-3327-45fe-a5f1-2006d966183f'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:59 devstack sudo[91246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:29:59 devstack sudo[91246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:59 devstack sudo[91245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b Apr 22 09:29:59 devstack sudo[91245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "cinder-20e3851d-2b03-457a-b192-9191d66e0454-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-20e3851d-2b03-457a-b192-9191d66e0454-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "cinder-quobyte-20e3851d-2b03-457a-b192-9191d66e0454" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-quobyte-20e3851d-2b03-457a-b192-9191d66e0454" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[691a7755-afd7-49d4-92f4-9baa4419e4b5]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:29:59 devstack sudo[91249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454 Apr 22 09:29:59 devstack sudo[91249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Flow 'volume_create_manager' (2cc266fe-d23a-4f90-a929-52a597645b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e360968-fca1-4fa8-9b62-7c7d7dd1d646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e360968-fca1-4fa8-9b62-7c7d7dd1d646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1372587689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7daff91942147beb523fc9ba54c2e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a6f3d533-0b03-484b-8d37-80f0b304bfcc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:00Z,use_quota=True,user_id='40a176eecf6e494382804d1a749d4131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7519955-6379-4a86-b90b-19e1d0fabbea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7519955-6379-4a86-b90b-19e1d0fabbea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea20cde-943e-477e-9c48-069efbf01472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ea20cde-943e-477e-9c48-069efbf01472) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff', 'volume_name': 'volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff', 'volume_size': 1, 'snapshot_id': 'a6f3d533-0b03-484b-8d37-80f0b304bfcc'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce50b75-7a35-4015-9db5-23c004b6ceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ce50b75-7a35-4015-9db5-23c004b6ceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967b2086-6799-4883-a346-9610f6a57dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:29:59 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Volume 93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff', 'volume_size': 1, 'snapshot_id': 'a6f3d533-0b03-484b-8d37-80f0b304bfcc'} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:29:59 devstack sudo[91246]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.461s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:29:59 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Deleted volume successfully. Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-4772296b-9613-471d-b90a-dfb81c1c9fe9 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-838fd898-666b-4a82-be5b-07461f72a998-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:29:59 devstack sudo[91245]: pam_unix(sudo:session): session closed for user root Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b" returned: 0 in 0.581s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:29:59 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:00 devstack sudo[91255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 1G Apr 22 09:30:00 devstack sudo[91255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:00 devstack sudo[91249]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454" returned: 0 in 0.573s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:00 devstack sudo[91260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454 Apr 22 09:30:00 devstack sudo[91260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:00 devstack sudo[91255]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 1G" returned: 0 in 0.465s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:00 devstack sudo[91265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 Apr 22 09:30:00 devstack sudo[91265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:00 devstack sudo[91260]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-20e3851d-2b03-457a-b192-9191d66e0454" returned: 0 in 0.447s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-quobyte-20e3851d-2b03-457a-b192-9191d66e0454" released by "delete_volume" :: held 1.042s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Created reservations ['7dba91f2-363f-454d-b14c-0dc8d836b2e5', '16a33f3e-f189-4bed-997c-aabd7557522c', '6514a485-a230-49b2-907e-0ab4fffe63af', 'f1966885-18cd-4d48-9d17-5b8bd98da544'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:00 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:00 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:00 devstack sudo[91265]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548" returned: 0 in 0.452s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:00 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 is being set with open permissions: ugo+rw Apr 22 09:30:00 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:00 devstack sudo[91273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 Apr 22 09:30:00 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:01 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.427s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:01 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Deleted volume successfully. Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-22f981c3-5605-4b3c-9158-ab57351bdc19 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-20e3851d-2b03-457a-b192-9191d66e0454-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:01 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548" returned: 0 in 0.420s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:01 devstack sudo[91278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.info Apr 22 09:30:01 devstack sudo[91278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "cinder-fda36daa-4d94-4f08-96ba-fa48786ee744-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-fda36daa-4d94-4f08-96ba-fa48786ee744-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "cinder-quobyte-fda36daa-4d94-4f08-96ba-fa48786ee744" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-quobyte-fda36daa-4d94-4f08-96ba-fa48786ee744" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:01 devstack sudo[91278]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.info" returned: 0 in 0.455s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:01 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.info is being set with open permissions: ugo+rw Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5a2eab-d15d-4800-b6f9-3a657463b916]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:01 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:01 devstack sudo[91281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.info Apr 22 09:30:01 devstack sudo[91281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:01 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744 Apr 22 09:30:01 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:02 devstack sudo[91281]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.info" returned: 0 in 0.405s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.848s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.536s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1974635158',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65419830-37f0-4b3f-b858-9cc29b839f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:54Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Creating volume 65419830-37f0-4b3f-b858-9cc29b839f2c {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:02 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:02 devstack sudo[91289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c 1073741824 Apr 22 09:30:02 devstack sudo[91289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:02 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-9959be51-ade1-424d-9dd5-eb7f6fb7f4e7 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Create snapshot completed successfully Apr 22 09:30:02 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744" returned: 0 in 0.478s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:02 devstack sudo[91291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744 Apr 22 09:30:02 devstack sudo[91291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:02 devstack sudo[91291]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-fda36daa-4d94-4f08-96ba-fa48786ee744" returned: 0 in 0.426s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-quobyte-fda36daa-4d94-4f08-96ba-fa48786ee744" released by "delete_volume" :: held 0.936s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:02 devstack sudo[91289]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c 1073741824" returned: 0 in 0.533s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Created reservations ['904f3de2-bce1-4160-be1c-78ced9905632', '01d8f150-9451-4350-8b55-b3dfed8d1d9c', '3aaa3c1b-ef8f-4c16-91d2-c537fab6c76b', '54ea005e-9d94-4290-b9f3-70b598367ad5'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:02 devstack sudo[91297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c Apr 22 09:30:02 devstack sudo[91297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:02 devstack sudo[91298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:02 devstack sudo[91298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "cinder-d7a9b560-7065-4c82-b891-c72dee11dde1-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (1ffd640c-dc61-4898-9c06-7d1ffc4338c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:02 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e65ec07-b3c0-46d8-b5b5-02fb100d1430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e65ec07-b3c0-46d8-b5b5-02fb100d1430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1309386468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e387ff-114f-4ee9-bec6-7e7ec037764c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:03Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493c3f59-dcc0-452c-8f27-ac1a758c01ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (493c3f59-dcc0-452c-8f27-ac1a758c01ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa75a38-9e01-4e72-be36-67f691d12b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3aa75a38-9e01-4e72-be36-67f691d12b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4e387ff-114f-4ee9-bec6-7e7ec037764c', 'volume_name': 'volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bbe274-df3c-4721-8be9-3502bcd98b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bbe274-df3c-4721-8be9-3502bcd98b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3891f875-b2ed-4466-ab39-b5e2ba3157f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume a4e387ff-114f-4ee9-bec6-7e7ec037764c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c', 'volume_size': 1} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-d7a9b560-7065-4c82-b891-c72dee11dde1-delete_volume" acquired by "delete_volume" :: waited 0.175s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "cinder-quobyte-d7a9b560-7065-4c82-b891-c72dee11dde1" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (12e9336d-003c-4f5b-8848-4de0e78c1938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea180f6-e5b2-48fc-8b93-f8fac783cf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea180f6-e5b2-48fc-8b93-f8fac783cf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1239286223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8993aa49-e6ed-461b-86ec-66aea89b6868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:03Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589cac24-47f5-47de-b478-f10665d749b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (589cac24-47f5-47de-b478-f10665d749b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2936ba2-7245-4248-b88a-179e482b3ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2936ba2-7245-4248-b88a-179e482b3ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8993aa49-e6ed-461b-86ec-66aea89b6868', 'volume_name': 'volume-8993aa49-e6ed-461b-86ec-66aea89b6868', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dceed6-aefa-4bf5-a1ad-24985f7d1444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47dceed6-aefa-4bf5-a1ad-24985f7d1444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b7fbac-131f-4936-8726-b22091354995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume 8993aa49-e6ed-461b-86ec-66aea89b6868: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8993aa49-e6ed-461b-86ec-66aea89b6868', 'volume_size': 1} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-quobyte-d7a9b560-7065-4c82-b891-c72dee11dde1" acquired by "delete_volume" :: waited 0.066s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1473d0-e0c8-4018-be0c-7baa59edf571]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:03 devstack sudo[91301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1 Apr 22 09:30:03 devstack sudo[91301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:03 devstack sudo[91298]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (994256ed-ce69-4561-9b72-98cb0b53273c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7b6cd7-c159-4652-97df-fa270bc68926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.542s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:03 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Deleted volume successfully. Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c7b6cd7-c159-4652-97df-fa270bc68926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14449133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f693c35-d3f9-43a1-86a8-1690aabc68a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:03Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaed0517-e65d-41f1-b503-c7997e44aecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aaed0517-e65d-41f1-b503-c7997e44aecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4fc19d-43dd-4019-bafe-4a096898b00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4fc19d-43dd-4019-bafe-4a096898b00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f693c35-d3f9-43a1-86a8-1690aabc68a8', 'volume_name': 'volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack sudo[91297]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddee8591-2781-454d-812f-d8568467156e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddee8591-2781-454d-812f-d8568467156e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11217d39-f7f5-4c39-8c34-6c6235220e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume 0f693c35-d3f9-43a1-86a8-1690aabc68a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8', 'volume_size': 1} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c" returned: 0 in 0.628s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] <== create_volume: return (1220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.538s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1392413115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8847df09-e605-475b-acb0-b17bffb65c65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:54Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Creating volume 8847df09-e605-475b-acb0-b17bffb65c65 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:03 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:03 devstack sudo[91305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65 1073741824 Apr 22 09:30:03 devstack sudo[91305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bf510ba-8bbb-46f3-bf0a-8868e462a45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65419830-37f0-4b3f-b858-9cc29b839f2c', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fb21c5-d819-4fa9-91e0-1383b81f0d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-fbfe89a8-2e62-4f44-b18c-438d701431b0 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-fda36daa-4d94-4f08-96ba-fa48786ee744-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:03 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume volume-65419830-37f0-4b3f-b858-9cc29b839f2c (65419830-37f0-4b3f-b858-9cc29b839f2c): created successfully Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97fb21c5-d819-4fa9-91e0-1383b81f0d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (fe86c6bb-b61c-4d78-b493-47cdcf952cb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:03 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-8e2c5b43-14de-433a-8f5b-35d8d663aa8b tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created volume successfully. Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (e06f4758-39ff-4747-8910-445f1a47d146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b440d061-bb81-43a2-ae02-03ea6ac3604f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b440d061-bb81-43a2-ae02-03ea6ac3604f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318719814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:04Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df76f5ca-9524-4867-8677-4a612cdcd9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df76f5ca-9524-4867-8677-4a612cdcd9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f852fa-e09d-4ccc-ac7b-d06caf33c050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41f852fa-e09d-4ccc-ac7b-d06caf33c050) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0', 'volume_name': 'volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9bb657-f22c-409c-b02c-67fc9d6481b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b9bb657-f22c-409c-b02c-67fc9d6481b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9c2fa3-a1cf-44af-9395-ac03e16ef849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume 6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0', 'volume_size': 1} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:03 devstack sudo[91301]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1" returned: 0 in 0.507s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:03 devstack sudo[91310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1 Apr 22 09:30:03 devstack sudo[91310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (b1345091-da35-4edc-9ae5-900b3c0c460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac351a0-f580-4b92-b1b2-3cd53132c812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac351a0-f580-4b92-b1b2-3cd53132c812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1817303124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22965e6-de8d-4b37-b7cd-b2af62357f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:04Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a4fa06-ca9a-40da-83cc-56ef7d3c78b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5a4fa06-ca9a-40da-83cc-56ef7d3c78b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c013d75d-5ccf-482a-9c64-bb020281a9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c013d75d-5ccf-482a-9c64-bb020281a9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22965e6-de8d-4b37-b7cd-b2af62357f96', 'volume_name': 'volume-d22965e6-de8d-4b37-b7cd-b2af62357f96', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5518075c-6b9b-4611-b0ca-efb25cf98cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5518075c-6b9b-4611-b0ca-efb25cf98cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bae2830-5882-4de3-b60e-46b9585a4488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:03 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume d22965e6-de8d-4b37-b7cd-b2af62357f96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22965e6-de8d-4b37-b7cd-b2af62357f96', 'volume_size': 1} Apr 22 09:30:03 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:04 devstack sudo[91305]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65 1073741824" returned: 0 in 0.635s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:04 devstack sudo[91310]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d7a9b560-7065-4c82-b891-c72dee11dde1" returned: 0 in 0.464s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:04 devstack sudo[91316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65 Apr 22 09:30:04 devstack sudo[91316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-quobyte-d7a9b560-7065-4c82-b891-c72dee11dde1" released by "delete_volume" :: held 0.995s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Created reservations ['51c53ed5-be11-451e-8cce-5fdf2f7b5aa9', '033b06e1-fe18-46ac-be23-58554ce8dc7d', '18043106-1f89-4c29-a155-53c73efeb1fe', '98e16939-b92f-49e8-8eb7-c54c45b860c1'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:04 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:04 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:04 devstack sudo[91316]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65" returned: 0 in 0.412s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.493s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-319996590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=455602c1-022d-4243-bdc8-b8514b38cfc9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:54Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Creating volume 455602c1-022d-4243-bdc8-b8514b38cfc9 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:04 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6225c43-5671-4be9-8551-e2eabf7e91fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8847df09-e605-475b-acb0-b17bffb65c65', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:04 devstack sudo[91322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9 1073741824 Apr 22 09:30:04 devstack sudo[91322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23c9544-604b-44d6-aba5-573f329de076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:04 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume volume-8847df09-e605-475b-acb0-b17bffb65c65 (8847df09-e605-475b-acb0-b17bffb65c65): created successfully Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23c9544-604b-44d6-aba5-573f329de076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (f7a80fc9-d893-4d9a-a703-0aa63915ab95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:04 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-5da0c650-5acc-4499-b157-7d79bb0350fb tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created volume successfully. Apr 22 09:30:04 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.403s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:04 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Deleted volume successfully. Apr 22 09:30:04 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25a15837-4a17-4d1d-bd93-321f2d8d7df5 tempest-CreateVolumesFromImageTest-859117189 None] Lock "cinder-d7a9b560-7065-4c82-b891-c72dee11dde1-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:05 devstack sudo[91322]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9 1073741824" returned: 0 in 0.494s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:05 devstack sudo[91327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9 Apr 22 09:30:05 devstack sudo[91327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:05 devstack sudo[91327]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9" returned: 0 in 0.470s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.292s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752261974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee66bb06-e6fe-496d-a22d-d384e926e27e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:54Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Creating volume ee66bb06-e6fe-496d-a22d-d384e926e27e {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:05 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deeb20d8-f760-4277-9942-b06cd46d83f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-455602c1-022d-4243-bdc8-b8514b38cfc9', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cc58c9-3c0a-4daf-b641-7c4bdba1f096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:05 devstack sudo[91330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e 1073741824 Apr 22 09:30:05 devstack sudo[91330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:05 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume volume-455602c1-022d-4243-bdc8-b8514b38cfc9 (455602c1-022d-4243-bdc8-b8514b38cfc9): created successfully Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8cc58c9-3c0a-4daf-b641-7c4bdba1f096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:05 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (4e559718-b1c3-48bb-b8fb-24d1017dd997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:05 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-874df163-b17c-42ab-8660-5797e1b317d0 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created volume successfully. Apr 22 09:30:06 devstack sudo[91330]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e 1073741824" returned: 0 in 0.572s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:06 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e Apr 22 09:30:06 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:06 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e" returned: 0 in 0.440s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.156s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:29:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-466968938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='615d4eea48144fafbf13fb25f98a4f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:29:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:29:54Z,use_quota=True,user_id='52af099185654818b03953483d5567b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Creating volume 5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:06 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (372574fd-90b4-43f1-8871-7710d2048954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee66bb06-e6fe-496d-a22d-d384e926e27e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:06 devstack sudo[91338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e 1073741824 Apr 22 09:30:06 devstack sudo[91338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa65757-e153-49ed-9a86-128a602c7421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:06 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume volume-ee66bb06-e6fe-496d-a22d-d384e926e27e (ee66bb06-e6fe-496d-a22d-d384e926e27e): created successfully Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fa65757-e153-49ed-9a86-128a602c7421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (2f78eda8-67dd-4e85-a445-f377258558b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:06 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-a3a2a8ec-1d93-4766-ad5f-1c809a343247 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created volume successfully. Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Flow 'volume_create_manager' (dcc1e707-f323-400d-9b3e-b3b0ca2f129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7903b92-f2ae-4d80-9c30-da888dd4357f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7903b92-f2ae-4d80-9c30-da888dd4357f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b5059c-95f1-4602-aaad-a4e9146c7f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2705362e7570490b8ff7410edf181cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:07Z,use_quota=True,user_id='bd67689e6f54426898b2192f8cca7f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88bfd493-3e33-428f-9831-32284caf72cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88bfd493-3e33-428f-9831-32284caf72cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40625361-8bbd-4d2c-a80a-9e920bd3f7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40625361-8bbd-4d2c-a80a-9e920bd3f7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b5059c-95f1-4602-aaad-a4e9146c7f7f', 'volume_name': 'volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9129a7dd-6718-4c56-8ade-5c69ab7b709d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9129a7dd-6718-4c56-8ade-5c69ab7b709d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2d9a1d-5d50-41ea-9fe1-c435e124ac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:06 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Volume 56b5059c-95f1-4602-aaad-a4e9146c7f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f', 'volume_size': 1} Apr 22 09:30:06 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:07 devstack sudo[91338]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e 1073741824" returned: 0 in 0.504s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:07 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e Apr 22 09:30:07 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:07 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e" returned: 0 in 0.415s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.660s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-quobyte-a6f3d533-0b03-484b-8d37-80f0b304bfcc-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" by "_create_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ba372e-8fc5-4e5c-ae17-c64c22bca778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399c1e28-cd3b-478b-af95-3014b732d4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-a6f3d533-0b03-484b-8d37-80f0b304bfcc-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Creating volume 93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff from snapshot a6f3d533-0b03-484b-8d37-80f0b304bfcc {{(pid=82642) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-quobyte-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:07 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Volume volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e (5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e): created successfully Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (399c1e28-cd3b-478b-af95-3014b732d4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Flow 'volume_create_manager' (1687890b-89ea-4b9d-a089-8791ffd371d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:07 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-04b64e80-00c1-473a-a4af-3895987fed84 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created volume successfully. Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] snapshot: a6f3d533-0b03-484b-8d37-80f0b304bfcc, volume: 93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0efd0de-5d41-4986-b542-0ed5f819ae0f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:07 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:07 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc Apr 22 09:30:07 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:08 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc" returned: 0 in 0.473s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09f25395-99ec-4f0b-acf6-b6898113f5b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae2e3a2-f9ac-4db1-8541-91868e15d94f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:08 devstack sudo[91351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 Apr 22 09:30:08 devstack sudo[91351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-quobyte-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a233cb6-93c5-4cdf-ad43-c22427266e4d]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:08 devstack sudo[91353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e Apr 22 09:30:08 devstack sudo[91353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:08 devstack sudo[91351]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8" returned: 0 in 0.502s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:08 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff Apr 22 09:30:08 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:08 devstack sudo[91353]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e" returned: 0 in 0.506s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:08 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:08 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e Apr 22 09:30:08 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:09 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e" returned: 0 in 0.722s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:09 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e" released by "delete_volume" :: held 1.265s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:09 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created reservations ['7cb85ca6-0371-4dc5-9b51-478815135e88', '3dc29f03-bc28-43c2-b895-f96ab08e2124', 'de4d7aa8-1415-4f2b-aa44-b3bf031c394d', '026d8c49-6caf-4652-81c6-d5c0455eabdd'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:09 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:09 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:10 devstack sudo[91376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:10 devstack sudo[91376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-ee66bb06-e6fe-496d-a22d-d384e926e27e-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-ee66bb06-e6fe-496d-a22d-d384e926e27e-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:10 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-quobyte-ee66bb06-e6fe-496d-a22d-d384e926e27e" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" returned: 0 in 2.053s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-ee66bb06-e6fe-496d-a22d-d384e926e27e" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef887e51-1861-4939-b737-3ec541a6a72f]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a37148d-607e-420e-a26c-3d6c4ba449e0]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:10 devstack sudo[91378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 Apr 22 09:30:10 devstack sudo[91378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:10 devstack sudo[91379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e Apr 22 09:30:10 devstack sudo[91379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:10 devstack sudo[91376]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.917s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:10 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Deleted volume successfully. Apr 22 09:30:10 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-931dfc2e-25f9-4365-86d9-1b93a5ca6e60 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-5d5656a1-43fb-474f-8fd5-61f2bd9dcd2e-delete_volume" released by "delete_volume" :: held 2.524s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:11 devstack sudo[91379]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e" returned: 0 in 0.487s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:11 devstack sudo[91389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e Apr 22 09:30:11 devstack sudo[91389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:11 devstack sudo[91378]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8" returned: 0 in 0.623s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8, size 1024.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:30:11 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Converted 1024.00 MB image at 498.46 MB/s Apr 22 09:30:11 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff is being set with open permissions: ugo+rw Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:11 devstack sudo[91394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff Apr 22 09:30:11 devstack sudo[91394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:11 devstack sudo[91389]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-ee66bb06-e6fe-496d-a22d-d384e926e27e" returned: 0 in 0.458s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-ee66bb06-e6fe-496d-a22d-d384e926e27e" released by "delete_volume" :: held 0.977s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created reservations ['0bd49b62-9614-47cf-b560-e4f3a5b38693', '0fa8791d-7ab8-4a9f-a726-d6aa0ede3b96', '8fff5ca8-c709-415c-b143-182386afbcd6', '1e2a7c1a-f39e-4fef-a0a5-16b87cc4ee83'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:11 devstack sudo[91394]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" returned: 0 in 0.440s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" released by "_copy_volume_from_snapshot" :: held 4.168s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-a6f3d533-0b03-484b-8d37-80f0b304bfcc-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" released by "_create_volume_from_snapshot" :: held 4.214s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.238s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.741s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1309386468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4e387ff-114f-4ee9-bec6-7e7ec037764c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:03Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Creating volume a4e387ff-114f-4ee9-bec6-7e7ec037764c {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:11 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:11 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:11 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:11 devstack sudo[91400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c 1073741824 Apr 22 09:30:11 devstack sudo[91400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (967b2086-6799-4883-a346-9610f6a57dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff', 'volume_size': 1, 'snapshot_id': 'a6f3d533-0b03-484b-8d37-80f0b304bfcc'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1b94c6-eec0-433e-8a30-5ecd46d06d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:11 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Volume volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff (93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff): created successfully Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc1b94c6-eec0-433e-8a30-5ecd46d06d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:11 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Flow 'volume_create_manager' (2cc266fe-d23a-4f90-a929-52a597645b2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:11 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e2642ffd-76dd-4176-8f21-5fbdf12165c9 tempest-VolumeDependencyTests-1225167530 None] Created volume successfully. Apr 22 09:30:12 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.444s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:12 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Deleted volume successfully. Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-eb9e2ba7-a779-42e5-bfe7-3a77c58bf880 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-ee66bb06-e6fe-496d-a22d-d384e926e27e-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:12 devstack sudo[91400]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c 1073741824" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:12 devstack sudo[91406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c Apr 22 09:30:12 devstack sudo[91406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-a6f3d533-0b03-484b-8d37-80f0b304bfcc-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-a6f3d533-0b03-484b-8d37-80f0b304bfcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-quobyte-09f25395-99ec-4f0b-acf6-b6898113f5b8" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:12 devstack sudo[91406]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c" returned: 0 in 0.439s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-09f25395-99ec-4f0b-acf6-b6898113f5b8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-quobyte-a6f3d533-0b03-484b-8d37-80f0b304bfcc" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.623s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1239286223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8993aa49-e6ed-461b-86ec-66aea89b6868,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:03Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Creating volume 8993aa49-e6ed-461b-86ec-66aea89b6868 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:12 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:12 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868 1073741824 Apr 22 09:30:12 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-455602c1-022d-4243-bdc8-b8514b38cfc9-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3891f875-b2ed-4466-ab39-b5e2ba3157f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be7a3fa-d09e-46d4-a655-f7876d1f3c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-a6f3d533-0b03-484b-8d37-80f0b304bfcc" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Deleting offline snapshot a6f3d533-0b03-484b-8d37-80f0b304bfcc of volume 09f25395-99ec-4f0b-acf6-b6898113f5b8 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] snapshot_file for this snap is: volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22a2384-f7dd-4566-8ffb-354bb535d253]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:12 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c (a4e387ff-114f-4ee9-bec6-7e7ec037764c): created successfully Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3be7a3fa-d09e-46d4-a655-f7876d1f3c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (1ffd640c-dc61-4898-9c06-7d1ffc4338c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-455602c1-022d-4243-bdc8-b8514b38cfc9-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:12 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-450cb4f6-71b9-405a-af1e-6825fadc991f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created volume successfully. Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-quobyte-455602c1-022d-4243-bdc8-b8514b38cfc9" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-455602c1-022d-4243-bdc8-b8514b38cfc9" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee59b2e-b3c6-45ca-937a-e0a4afd24f2e]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:12 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:12 devstack sudo[91411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc Apr 22 09:30:12 devstack sudo[91411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:13 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9 Apr 22 09:30:13 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:13 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868 1073741824" returned: 0 in 0.527s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:13 devstack sudo[91422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868 Apr 22 09:30:13 devstack sudo[91422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:13 devstack sudo[91411]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:13 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc" returned: 0 in 0.576s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09f25395-99ec-4f0b-acf6-b6898113f5b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9" returned: 0 in 0.524s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[397fb743-bcea-4080-a3bd-2f1696371a21]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:13 devstack sudo[91426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9 Apr 22 09:30:13 devstack sudo[91426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:13 devstack sudo[91427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 Apr 22 09:30:13 devstack sudo[91427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:13 devstack sudo[91422]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868" returned: 0 in 0.437s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.376s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-14449133',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f693c35-d3f9-43a1-86a8-1690aabc68a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:03Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Creating volume 0f693c35-d3f9-43a1-86a8-1690aabc68a8 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:13 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:13 devstack sudo[91431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8 1073741824 Apr 22 09:30:13 devstack sudo[91431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21b7fbac-131f-4936-8726-b22091354995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8993aa49-e6ed-461b-86ec-66aea89b6868', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a028b0-7344-4679-86fb-cd4caad08897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:13 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume volume-8993aa49-e6ed-461b-86ec-66aea89b6868 (8993aa49-e6ed-461b-86ec-66aea89b6868): created successfully Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53a028b0-7344-4679-86fb-cd4caad08897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (12e9336d-003c-4f5b-8848-4de0e78c1938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:13 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e26c3d83-7da5-47c6-a63b-974a1892dc48 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created volume successfully. Apr 22 09:30:13 devstack sudo[91426]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-455602c1-022d-4243-bdc8-b8514b38cfc9" returned: 0 in 0.457s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-455602c1-022d-4243-bdc8-b8514b38cfc9" released by "delete_volume" :: held 1.002s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:13 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created reservations ['c4127ac0-b9c1-47f3-9c71-28a7a9562fe6', 'e24eb00b-320d-4aba-bbe8-fa634e3a8462', 'e0ca45c5-7600-4b81-9a8c-dcc6a49b40ed', 'ad1998db-f369-4bd6-b8dd-6667d4a2a0da'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:14 devstack sudo[91427]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8" returned: 0 in 0.544s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:14 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:14 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:14 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc Apr 22 09:30:14 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:14 devstack sudo[91431]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8 1073741824" returned: 0 in 0.532s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:14 devstack sudo[91445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8 Apr 22 09:30:14 devstack sudo[91445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:14 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.457s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:14 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Deleted volume successfully. Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-27fa5999-7891-41fb-8f83-f19621c7756e tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-455602c1-022d-4243-bdc8-b8514b38cfc9-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:14 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:14 devstack sudo[91450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc Apr 22 09:30:14 devstack sudo[91450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:14 devstack sudo[91445]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8" returned: 0 in 0.442s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.129s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-318719814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:04Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Creating volume 6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:14 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11217d39-f7f5-4c39-8c34-6c6235220e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89c62f0-009a-46b3-9d41-3b706acd8b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:14 devstack sudo[91453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0 1073741824 Apr 22 09:30:14 devstack sudo[91453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:14 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8 (0f693c35-d3f9-43a1-86a8-1690aabc68a8): created successfully Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89c62f0-009a-46b3-9d41-3b706acd8b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:14 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (994256ed-ce69-4561-9b72-98cb0b53273c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:14 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-cd023b7f-ead5-42ba-b737-2b3d548cad01 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created volume successfully. Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-8847df09-e605-475b-acb0-b17bffb65c65-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-8847df09-e605-475b-acb0-b17bffb65c65-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:15 devstack sudo[91450]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8.a6f3d533-0b03-484b-8d37-80f0b304bfcc" returned: 0 in 0.463s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-quobyte-8847df09-e605-475b-acb0-b17bffb65c65" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-a6f3d533-0b03-484b-8d37-80f0b304bfcc" released by "_delete_snapshot" :: held 2.216s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-8847df09-e605-475b-acb0-b17bffb65c65" acquired by "delete_volume" :: waited 0.031s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-09f25395-99ec-4f0b-acf6-b6898113f5b8" released by "delete_snapshot" :: held 2.290s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[e739d240-37c8-4879-8c09-3e089fd66342]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Created reservations ['ad8189a1-3ecd-4197-a3b6-a39bd88197e2', 'c1db4673-e257-43e0-b8cd-1306c447b9cf', '0960fa79-e6f4-49bf-8d9a-c51b079ec3b6', 'e244daf6-f90c-4399-b382-d02455f4722f'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:15 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65 Apr 22 09:30:15 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:15 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Delete snapshot completed successfully. Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b861034e-a183-442e-b97c-fcf1d13f999a tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-a6f3d533-0b03-484b-8d37-80f0b304bfcc-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:15 devstack sudo[91453]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0 1073741824" returned: 0 in 0.537s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:15 devstack sudo[91461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0 Apr 22 09:30:15 devstack sudo[91461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:15 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65" returned: 0 in 0.497s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:15 devstack sudo[91466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65 Apr 22 09:30:15 devstack sudo[91466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:15 devstack sudo[91461]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0" returned: 0 in 0.417s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.870s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1817303124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22965e6-de8d-4b37-b7cd-b2af62357f96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9547d177e214643a97dea311fa88eef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:04Z,use_quota=True,user_id='c6c33ab924ab4d4cb7a9faae3161372f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Creating volume d22965e6-de8d-4b37-b7cd-b2af62357f96 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:15 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff9c2fa3-a1cf-44af-9395-ac03e16ef849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf19f60-5748-42a8-b3d2-64f6a27ea159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:15 devstack sudo[91469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96 1073741824 Apr 22 09:30:15 devstack sudo[91469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:15 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0 (6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0): created successfully Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9bf19f60-5748-42a8-b3d2-64f6a27ea159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (e06f4758-39ff-4747-8910-445f1a47d146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:15 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e8d098e0-d5e9-4691-9ce7-4be77d87600f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created volume successfully. Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-09f25395-99ec-4f0b-acf6-b6898113f5b8-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-09f25395-99ec-4f0b-acf6-b6898113f5b8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-quobyte-09f25395-99ec-4f0b-acf6-b6898113f5b8" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-09f25395-99ec-4f0b-acf6-b6898113f5b8" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[804c90ac-9f3b-43db-9630-76f1642ccedb]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:15 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:16 devstack sudo[91472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 Apr 22 09:30:16 devstack sudo[91472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:16 devstack sudo[91466]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8847df09-e605-475b-acb0-b17bffb65c65" returned: 0 in 0.447s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-8847df09-e605-475b-acb0-b17bffb65c65" released by "delete_volume" :: held 0.968s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created reservations ['a4a9eb54-3904-486b-8ed6-ff63db4bc32b', 'b255d0a5-4be6-479e-a647-f6350478e501', 'aad81fe0-dbc4-4a3c-8f0a-b63d5b1977c0', '93e8f657-868a-4352-9736-623b931d085b'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:16 devstack sudo[91474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:16 devstack sudo[91474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:16 devstack sudo[91469]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96 1073741824" returned: 0 in 0.556s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:16 devstack sudo[91482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96 Apr 22 09:30:16 devstack sudo[91482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:16 devstack sudo[91472]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8" returned: 0 in 0.488s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:16 devstack sudo[91484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8 Apr 22 09:30:16 devstack sudo[91484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:16 devstack sudo[91474]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.432s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Deleted volume successfully. Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1254e3ae-0372-40ee-b51c-43eda2f62041 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-8847df09-e605-475b-acb0-b17bffb65c65-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:16 devstack sudo[91482]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96" returned: 0 in 0.416s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.929s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b5059c-95f1-4602-aaad-a4e9146c7f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2705362e7570490b8ff7410edf181cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:07Z,use_quota=True,user_id='bd67689e6f54426898b2192f8cca7f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Creating volume 56b5059c-95f1-4602-aaad-a4e9146c7f7f {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:16 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bae2830-5882-4de3-b60e-46b9585a4488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22965e6-de8d-4b37-b7cd-b2af62357f96', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:16 devstack sudo[91488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f 1073741824 Apr 22 09:30:16 devstack sudo[91488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537bbced-823b-4fe7-889a-8c276f96ee2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:16 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Volume volume-d22965e6-de8d-4b37-b7cd-b2af62357f96 (d22965e6-de8d-4b37-b7cd-b2af62357f96): created successfully Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537bbced-823b-4fe7-889a-8c276f96ee2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Flow 'volume_create_manager' (b1345091-da35-4edc-9ae5-900b3c0c460d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:16 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-3471acb4-5987-44bc-ac55-a27dc63f731f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created volume successfully. Apr 22 09:30:16 devstack sudo[91484]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-09f25395-99ec-4f0b-acf6-b6898113f5b8" returned: 0 in 0.458s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-09f25395-99ec-4f0b-acf6-b6898113f5b8" released by "delete_volume" :: held 0.975s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Created reservations ['855ff693-86af-431c-827c-fb7eb46bfb8b', '2f529ec9-a56b-4881-8abf-fa003183639d', '01202280-5689-4052-9526-337c2e4ca566', '7e8e2817-4db6-4f6d-912b-ed5647298521'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:16 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:17 devstack sudo[91491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:17 devstack sudo[91491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-65419830-37f0-4b3f-b858-9cc29b839f2c-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-65419830-37f0-4b3f-b858-9cc29b839f2c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-quobyte-65419830-37f0-4b3f-b858-9cc29b839f2c" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-65419830-37f0-4b3f-b858-9cc29b839f2c" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86d1106-5d07-4dd7-9799-5fcaabb0e86b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Flow 'volume_create_manager' (27eba74e-bf31-4411-a445-efb86afb36f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2c3e0b-1d54-41be-92df-94ab852521cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2c3e0b-1d54-41be-92df-94ab852521cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1068746636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37ca264-7849-4794-ba76-0a8d9b1c14b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7daff91942147beb523fc9ba54c2e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:17Z,use_quota=True,user_id='40a176eecf6e494382804d1a749d4131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0808f7fb-a867-4bc0-a5fc-85ffd2690db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0808f7fb-a867-4bc0-a5fc-85ffd2690db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8ed82e-edce-49dc-b6c8-39deb38a601b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b8ed82e-edce-49dc-b6c8-39deb38a601b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b37ca264-7849-4794-ba76-0a8d9b1c14b7', 'volume_name': 'volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:17 devstack sudo[91496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297c9259-7656-4169-8d69-92deb682a9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:17 devstack sudo[91496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297c9259-7656-4169-8d69-92deb682a9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7850d11-9e68-4857-b8f6-b4f8723b5f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:17 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Volume b37ca264-7849-4794-ba76-0a8d9b1c14b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7', 'volume_size': 1} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:17 devstack sudo[91488]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f 1073741824" returned: 0 in 0.590s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:17 devstack sudo[91498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f Apr 22 09:30:17 devstack sudo[91498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:17 devstack sudo[91491]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.512s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Deleted volume successfully. Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ad615e04-3e2f-49c5-90f6-4d53375ecbfb tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-09f25395-99ec-4f0b-acf6-b6898113f5b8-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:17 devstack sudo[91496]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:17 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c Apr 22 09:30:17 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-d22965e6-de8d-4b37-b7cd-b2af62357f96-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-d22965e6-de8d-4b37-b7cd-b2af62357f96-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:17 devstack sudo[91498]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f" returned: 0 in 0.430s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.488s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1068746636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b37ca264-7849-4794-ba76-0a8d9b1c14b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7daff91942147beb523fc9ba54c2e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:17Z,use_quota=True,user_id='40a176eecf6e494382804d1a749d4131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Creating volume b37ca264-7849-4794-ba76-0a8d9b1c14b7 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:17 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:17 devstack sudo[91507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 1073741824 Apr 22 09:30:17 devstack sudo[91507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c2d9a1d-5d50-41ea-9fe1-c435e124ac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4020c2-7c56-43fc-89b9-c20d49476544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-quobyte-d22965e6-de8d-4b37-b7cd-b2af62357f96" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:17 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Volume volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f (56b5059c-95f1-4602-aaad-a4e9146c7f7f): created successfully Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd4020c2-7c56-43fc-89b9-c20d49476544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Flow 'volume_create_manager' (dcc1e707-f323-400d-9b3e-b3b0ca2f129f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-d22965e6-de8d-4b37-b7cd-b2af62357f96" acquired by "delete_volume" :: waited 0.019s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f51b7f-320c-4fbd-9e49-4e4f84f31fa0]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:17 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:17 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e0b285a3-bd58-4f54-a0f2-319bc6dbc8b4 tempest-CinderUnicodeTest-1727626186 None] Created volume successfully. Apr 22 09:30:18 devstack sudo[91509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96 Apr 22 09:30:18 devstack sudo[91509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:18 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-65419830-37f0-4b3f-b858-9cc29b839f2c" returned: 0 in 0.459s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-65419830-37f0-4b3f-b858-9cc29b839f2c" released by "delete_volume" :: held 1.005s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created reservations ['f6d09b14-f331-4dbc-9817-0c2fae0949d8', '521b3ccb-75b7-418d-9228-940d841dd0c7', '43deda54-7e9a-4b7c-a43f-62e033825c5f', '2c3c13ec-0527-460b-b0c1-f4097ab4d0b0'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:18 devstack sudo[91515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:18 devstack sudo[91515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:18 devstack sudo[91507]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:18 devstack sudo[91509]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 1073741824" returned: 0 in 0.617s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96" returned: 0 in 0.541s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:18 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96 Apr 22 09:30:18 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:18 devstack sudo[91522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 Apr 22 09:30:18 devstack sudo[91522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:30:18 devstack sudo[91515]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Flow 'volume_create_manager' (bc584202-d3a1-4ec4-8d86-5680b04916ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03478510-3a15-4f0b-a85e-582e6d6136a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.460s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:18 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Deleted volume successfully. Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03478510-3a15-4f0b-a85e-582e6d6136a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-541330390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536765d0-def5-475c-bc8a-7746e86a66d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2705362e7570490b8ff7410edf181cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:19Z,use_quota=True,user_id='bd67689e6f54426898b2192f8cca7f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b43651-66f7-478f-9e26-a3632b144202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4b43651-66f7-478f-9e26-a3632b144202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cec311f-266e-4c83-8e5e-9b532df758de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cec311f-266e-4c83-8e5e-9b532df758de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '536765d0-def5-475c-bc8a-7746e86a66d3', 'volume_name': 'volume-536765d0-def5-475c-bc8a-7746e86a66d3', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203cabd1-091e-4596-937b-6371c730062c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (203cabd1-091e-4596-937b-6371c730062c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4aa3894-ef87-4508-abba-f2883860ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:18 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Volume 536765d0-def5-475c-bc8a-7746e86a66d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-536765d0-def5-475c-bc8a-7746e86a66d3', 'volume_size': 1} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:18 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-96363b88-d6ba-405c-b808-e43f3814b9fd tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-65419830-37f0-4b3f-b858-9cc29b839f2c-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:19 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-d22965e6-de8d-4b37-b7cd-b2af62357f96" returned: 0 in 0.509s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-d22965e6-de8d-4b37-b7cd-b2af62357f96" released by "delete_volume" :: held 1.071s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created reservations ['ded02124-6813-4d72-b559-d2487897cfde', 'ab90b813-754b-47bb-a88b-debc4d020da2', '2f632590-72b3-49e0-9e46-5d61812d57a9', 'af9699c9-0482-4fd7-9fa5-41a5e9f4b24c'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:19 devstack sudo[91522]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7" returned: 0 in 0.560s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.226s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-541330390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=536765d0-def5-475c-bc8a-7746e86a66d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2705362e7570490b8ff7410edf181cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:19Z,use_quota=True,user_id='bd67689e6f54426898b2192f8cca7f95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Creating volume 536765d0-def5-475c-bc8a-7746e86a66d3 {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:19 devstack sudo[91527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:19 devstack sudo[91527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:19 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7850d11-9e68-4857-b8f6-b4f8723b5f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e6fb1d-f5aa-4f6e-9117-d185bdb03e07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:19 devstack sudo[91529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 1073741824 Apr 22 09:30:19 devstack sudo[91529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:19 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Volume volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 (b37ca264-7849-4794-ba76-0a8d9b1c14b7): created successfully Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71e6fb1d-f5aa-4f6e-9117-d185bdb03e07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Flow 'volume_create_manager' (27eba74e-bf31-4411-a445-efb86afb36f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:19 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-622d5a32-045a-472d-a048-8b9f373cd1e7 tempest-VolumeDependencyTests-1225167530 None] Created volume successfully. Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-9f1933ce-591e-4676-8c39-92f1e87900a8-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-9f1933ce-591e-4676-8c39-92f1e87900a8-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "cinder-quobyte-9f1933ce-591e-4676-8c39-92f1e87900a8" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-9f1933ce-591e-4676-8c39-92f1e87900a8" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[9692ab83-9e66-4867-b423-848574914bd0]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:19 devstack sudo[91527]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.479s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:19 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Deleted volume successfully. Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-53c25a44-8d07-41f8-991d-3f755521801f tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-d22965e6-de8d-4b37-b7cd-b2af62357f96-delete_volume" released by "delete_volume" :: held 1.727s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:19 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8 Apr 22 09:30:19 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:19 devstack sudo[91529]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 1073741824" returned: 0 in 0.587s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:19 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 Apr 22 09:30:19 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Flow 'volume_create_manager' (237dae29-f238-49b5-8d59-07a99b188200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec98c49f-c307-4e61-92bf-1f64f849c21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec98c49f-c307-4e61-92bf-1f64f849c21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-750134127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=530416da-b4fc-462d-8cd4-0e3d76bb5d77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7daff91942147beb523fc9ba54c2e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b37ca264-7849-4794-ba76-0a8d9b1c14b7,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:20Z,use_quota=True,user_id='40a176eecf6e494382804d1a749d4131',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b9502c-7611-483f-924a-3fc537904a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b9502c-7611-483f-924a-3fc537904a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d71e0c-d4b6-4749-a5f2-c845e455bce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d71e0c-d4b6-4749-a5f2-c845e455bce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '530416da-b4fc-462d-8cd4-0e3d76bb5d77', 'volume_name': 'volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77', 'volume_size': 1, 'source_volid': 'b37ca264-7849-4794-ba76-0a8d9b1c14b7', 'source_volstatus': 'available'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbcccbe-e26a-4cf2-9cd1-efb4484a7d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6dbcccbe-e26a-4cf2-9cd1-efb4484a7d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eaf4266-c602-40af-81ef-206b1579a4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:19 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Volume 530416da-b4fc-462d-8cd4-0e3d76bb5d77: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77', 'volume_size': 1, 'source_volid': 'b37ca264-7849-4794-ba76-0a8d9b1c14b7', 'source_volstatus': 'available'} Apr 22 09:30:19 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-quobyte-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:20 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8" returned: 0 in 0.587s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[0680d28e-bf1f-4566-b5c0-fe4bdb0af6cb]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:20 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8 Apr 22 09:30:20 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:20 devstack sudo[91544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0 Apr 22 09:30:20 devstack sudo[91544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:20 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3" returned: 0 in 0.468s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.380s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:20 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Cloning volume b37ca264-7849-4794-ba76-0a8d9b1c14b7 to volume 530416da-b4fc-462d-8cd4-0e3d76bb5d77 Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4aa3894-ef87-4508-abba-f2883860ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-536765d0-def5-475c-bc8a-7746e86a66d3', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62eefdca-2f11-4b3e-a437-1ebb6188e0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:20 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Volume volume-536765d0-def5-475c-bc8a-7746e86a66d3 (536765d0-def5-475c-bc8a-7746e86a66d3): created successfully Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62eefdca-2f11-4b3e-a437-1ebb6188e0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Flow 'volume_create_manager' (bc584202-d3a1-4ec4-8d86-5680b04916ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Creating offline snapshot 2daeeecb-d352-44eb-a23c-b70ef0f7c60c of volume b37ca264-7849-4794-ba76-0a8d9b1c14b7 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:30:20 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-0de0bd6e-7938-4d3f-a256-d2c0baf1ee80 tempest-CinderUnicodeTest-1727626186 None] Created volume successfully. Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d245ab0-056c-4366-8ff9-7d432a0b540b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:20 devstack sudo[91547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 Apr 22 09:30:20 devstack sudo[91547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:20 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-9f1933ce-591e-4676-8c39-92f1e87900a8" returned: 0 in 0.431s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-quobyte-9f1933ce-591e-4676-8c39-92f1e87900a8" released by "delete_volume" :: held 1.053s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Created reservations ['57e69173-578d-433b-aef0-546d8d4f1ff2', 'd84ae2b4-3355-4514-bb8e-f858efbade4d', 'ae4a918b-14f7-4725-bad0-74103ddaf061', '42b1a2e5-e822-4938-a8ff-5f4db7788d4b'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:20 devstack sudo[91553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:20 devstack sudo[91553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:20 devstack sudo[91544]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0" returned: 0 in 0.541s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:20 devstack sudo[91555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0 Apr 22 09:30:20 devstack sudo[91555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:20 devstack sudo[91547]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7" returned: 0 in 0.514s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:20 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:20 devstack sudo[91560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c 1G Apr 22 09:30:20 devstack sudo[91560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:21 devstack sudo[91553]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.457s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:21 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Deleted volume successfully. Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a748f97-d694-42d8-b9f9-8ea2fd778781 tempest-CreateVolumesFromSourceVolumeTest-937041051 None] Lock "cinder-9f1933ce-591e-4676-8c39-92f1e87900a8-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:21 devstack sudo[91555]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0" returned: 0 in 0.519s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0" released by "delete_volume" :: held 1.106s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created reservations ['d326b11a-e3b8-4a0a-ad5f-c5969dceb575', '7bebefd4-7a74-4778-aab6-15219b5b2b84', '6af6b8f4-0904-4912-be47-ccaa103a6e6d', '29ed9d72-a215-45b5-8f01-32c2d9a4817d'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:21 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:21 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:21 devstack sudo[91560]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c 1G" returned: 0 in 0.560s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:21 devstack sudo[91570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c Apr 22 09:30:21 devstack sudo[91570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:21 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.413s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:21 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Deleted volume successfully. Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-00424532-d076-4b04-9f32-fb80d3c579ae tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-6c7e00a2-eee5-43e8-abaf-bcb4b0be8ff0-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:21 devstack sudo[91570]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c" returned: 0 in 0.466s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:21 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c is being set with open permissions: ugo+rw Apr 22 09:30:21 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:21 devstack sudo[91576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c Apr 22 09:30:21 devstack sudo[91576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-0f693c35-d3f9-43a1-86a8-1690aabc68a8-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-0f693c35-d3f9-43a1-86a8-1690aabc68a8-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-quobyte-0f693c35-d3f9-43a1-86a8-1690aabc68a8" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:22 devstack sudo[91576]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c" returned: 0 in 0.501s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-0f693c35-d3f9-43a1-86a8-1690aabc68a8" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffca086-801f-4c85-9098-656339b83d3c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:22 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.info Apr 22 09:30:22 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:22 devstack sudo[91580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8 Apr 22 09:30:22 devstack sudo[91580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:22 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.info" returned: 0 in 0.451s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:22 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.info is being set with open permissions: ugo+rw Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:22 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.info Apr 22 09:30:22 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:22 devstack sudo[91580]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8" returned: 0 in 0.573s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:22 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:22 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8 Apr 22 09:30:22 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:23 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.info" returned: 0 in 0.446s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-quobyte-530416da-b4fc-462d-8cd4-0e3d76bb5d77" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-530416da-b4fc-462d-8cd4-0e3d76bb5d77" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] snapshot: 2daeeecb-d352-44eb-a23c-b70ef0f7c60c, volume: 530416da-b4fc-462d-8cd4-0e3d76bb5d77, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[c250eafa-3ac1-4d47-a89e-756b258dff78]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:23 devstack sudo[91594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c Apr 22 09:30:23 devstack sudo[91594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:23 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-0f693c35-d3f9-43a1-86a8-1690aabc68a8" returned: 0 in 0.486s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-0f693c35-d3f9-43a1-86a8-1690aabc68a8" released by "delete_volume" :: held 1.096s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created reservations ['3f4cc977-3516-4527-b238-2c08b8b031d5', 'f2416081-6ba6-4d4f-b30a-cb44d92c28e3', '10abb621-8b92-4632-97bc-c7e629a4c6f7', 'fe083512-d807-40d5-8caa-eb2d15e9bfbb'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:23 devstack sudo[91596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:23 devstack sudo[91596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:23 devstack sudo[91594]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c" returned: 0 in 0.560s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f487cf6a-ec4d-47ea-9461-c30cd6a0c845]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:23 devstack sudo[91596]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.457s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:23 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Deleted volume successfully. Apr 22 09:30:23 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 Apr 22 09:30:23 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:23 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-1ac6bb2e-8a80-4e43-ae4c-cfc95bdc7a83 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-0f693c35-d3f9-43a1-86a8-1690aabc68a8-delete_volume" released by "delete_volume" :: held 1.701s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:24 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7" returned: 0 in 0.526s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:24 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:30:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:24 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 Apr 22 09:30:24 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-8993aa49-e6ed-461b-86ec-66aea89b6868-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-8993aa49-e6ed-461b-86ec-66aea89b6868-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-quobyte-8993aa49-e6ed-461b-86ec-66aea89b6868" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:24 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-8993aa49-e6ed-461b-86ec-66aea89b6868" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:24 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2dedee-9eea-4b51-bb8c-794c7e43fc3e]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:24 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:24 devstack sudo[91609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868 Apr 22 09:30:24 devstack sudo[91609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:25 devstack sudo[91609]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868" returned: 0 in 1.000s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:25 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:25 devstack sudo[91625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868 Apr 22 09:30:25 devstack sudo[91625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:26 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77" returned: 0 in 2.197s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1927674a-edf8-4db5-a70c-0731799db0c6]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:26 devstack sudo[91628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 Apr 22 09:30:26 devstack sudo[91628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:26 devstack sudo[91625]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-8993aa49-e6ed-461b-86ec-66aea89b6868" returned: 0 in 1.165s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-8993aa49-e6ed-461b-86ec-66aea89b6868" released by "delete_volume" :: held 2.188s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created reservations ['ea084f05-7820-45fd-bd66-353afab99be3', '21a4216d-e164-428c-843a-4fcd62a7f942', 'e679a111-f523-4578-8c40-05d48e800712', 'efa22b80-3ff1-46cf-88a3-9dacf56b924e'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:26 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:26 devstack sudo[91630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:26 devstack sudo[91630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:27 devstack sudo[91630]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.455s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:27 devstack sudo[91628]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:27 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Deleted volume successfully. Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7" returned: 0 in 0.678s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7, size 1024.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:30:27 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Converted 1024.00 MB image at 465.87 MB/s Apr 22 09:30:27 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 is being set with open permissions: ugo+rw Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:27 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 Apr 22 09:30:27 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b8dcac5c-8c98-4157-b3d2-eaf0f0ad9fa2 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-8993aa49-e6ed-461b-86ec-66aea89b6868-delete_volume" released by "delete_volume" :: held 2.838s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-a4e387ff-114f-4ee9-bec6-7e7ec037764c-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-a4e387ff-114f-4ee9-bec6-7e7ec037764c-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:27 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-quobyte-a4e387ff-114f-4ee9-bec6-7e7ec037764c" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77" returned: 0 in 0.509s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-530416da-b4fc-462d-8cd4-0e3d76bb5d77" released by "_copy_volume_from_snapshot" :: held 4.529s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-a4e387ff-114f-4ee9-bec6-7e7ec037764c" acquired by "delete_volume" :: waited 0.013s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-quobyte-2daeeecb-d352-44eb-a23c-b70ef0f7c60c" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[553c76a2-cfdb-4835-86b1-88d8858c1ade]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-2daeeecb-d352-44eb-a23c-b70ef0f7c60c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Deleting offline snapshot 2daeeecb-d352-44eb-a23c-b70ef0f7c60c of volume b37ca264-7849-4794-ba76-0a8d9b1c14b7 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] snapshot_file for this snap is: volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[892dcf59-777d-4d62-9afc-07b633b65747]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:27 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:27 devstack sudo[91639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c Apr 22 09:30:27 devstack sudo[91639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:27 devstack sudo[91640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c Apr 22 09:30:27 devstack sudo[91640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:28 devstack sudo[91640]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:28 devstack sudo[91639]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c" returned: 0 in 0.556s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c" returned: 0 in 0.598s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3579cb02-0989-45b8-a575-6e4b34ddc6fa]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:28 devstack sudo[91649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c Apr 22 09:30:28 devstack sudo[91649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:28 devstack sudo[91650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 Apr 22 09:30:28 devstack sudo[91650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:28 devstack sudo[91649]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-a4e387ff-114f-4ee9-bec6-7e7ec037764c" returned: 0 in 0.459s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-a4e387ff-114f-4ee9-bec6-7e7ec037764c" released by "delete_volume" :: held 1.083s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created reservations ['8baa73ee-f2ed-4fd9-846a-20ba9685b900', '902b99c0-4eec-4745-b7d7-9775515b5458', 'e12932f2-624a-4ba8-bd03-710fa9cc3f57', 'd138697f-eb26-4885-a9e3-6f2be4e0284d'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:28 devstack sudo[91650]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7" returned: 0 in 0.565s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:28 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:28 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:28 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:29 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c Apr 22 09:30:29 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:29 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.450s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:29 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Deleted volume successfully. Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-01a02d0d-168a-4606-880c-ad7e44dfdfe6 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-a4e387ff-114f-4ee9-bec6-7e7ec037764c-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:29 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c" returned: 0 in 0.598s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:29 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c Apr 22 09:30:29 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-quobyte-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b" acquired by "delete_snapshot" :: waited 0.025s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-quobyte-5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Deleting offline snapshot 5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 of volume 6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] snapshot_file for this snap is: volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdfadc6-9bed-4cc3-b9d5-bd01bb69d458]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:29 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:30 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 Apr 22 09:30:30 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:30 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7.2daeeecb-d352-44eb-a23c-b70ef0f7c60c" returned: 0 in 0.508s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-2daeeecb-d352-44eb-a23c-b70ef0f7c60c" released by "_delete_snapshot" :: held 2.284s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.929s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.972s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eaf4266-c602-40af-81ef-206b1579a4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77', 'volume_size': 1, 'source_volid': 'b37ca264-7849-4794-ba76-0a8d9b1c14b7', 'source_volstatus': 'available'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de7ddf0-e54d-4168-8a5a-fe6fccb16fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] Creating offline snapshot 14bd3641-a4a4-4603-bf8e-8b7b642ef08e of volume 536765d0-def5-475c-bc8a-7746e86a66d3 {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:30:30 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Volume volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 (530416da-b4fc-462d-8cd4-0e3d76bb5d77): created successfully Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7de7ddf0-e54d-4168-8a5a-fe6fccb16fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Flow 'volume_create_manager' (237dae29-f238-49b5-8d59-07a99b188200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f799515-9086-4a92-beb8-a1eb9a96be4c]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:30 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-9c914005-0be1-4a54-81b6-759a547c65c7 tempest-VolumeDependencyTests-1225167530 None] Created volume successfully. Apr 22 09:30:30 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 Apr 22 09:30:30 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:30 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548" returned: 0 in 0.596s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9c694c-3d63-426c-9dc5-c704287c7804]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_service.periodic_task [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82642) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:30 devstack sudo[91680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:30 devstack sudo[91676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b Apr 22 09:30:30 devstack sudo[91680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:30 devstack sudo[91676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-b37ca264-7849-4794-ba76-0a8d9b1c14b7-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-b37ca264-7849-4794-ba76-0a8d9b1c14b7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-quobyte-b37ca264-7849-4794-ba76-0a8d9b1c14b7" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-b37ca264-7849-4794-ba76-0a8d9b1c14b7" acquired by "delete_volume" :: waited 0.018s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[b868b336-918f-4437-bc80-ea2d3d1cdfe5]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:30 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:30 devstack sudo[91683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 Apr 22 09:30:30 devstack sudo[91683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:31 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3" returned: 0 in 0.860s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:31 devstack sudo[91685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e 1G Apr 22 09:30:31 devstack sudo[91685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:31 devstack sudo[91676]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b" returned: 0 in 0.789s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:31 devstack sudo[91691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 Apr 22 09:30:31 devstack sudo[91691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:31 devstack sudo[91680]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.994s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:31 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-11db7a5e-505f-4d02-93b0-e76f9d9379fc None None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:31 devstack sudo[91683]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7" returned: 0 in 0.892s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:31 devstack sudo[91700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7 Apr 22 09:30:31 devstack sudo[91700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:31 devstack sudo[91685]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e 1G" returned: 0 in 0.804s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:31 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536765d0-def5-475c-bc8a-7746e86a66d3 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:31 devstack sudo[91702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536765d0-def5-475c-bc8a-7746e86a66d3 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e Apr 22 09:30:31 devstack sudo[91702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:32 devstack sudo[91691]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548" returned: 0 in 0.702s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:32 devstack sudo[91707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548 Apr 22 09:30:32 devstack sudo[91707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:32 devstack sudo[91700]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-b37ca264-7849-4794-ba76-0a8d9b1c14b7" returned: 0 in 0.556s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-b37ca264-7849-4794-ba76-0a8d9b1c14b7" released by "delete_volume" :: held 1.500s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:32 devstack sudo[91702]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Created reservations ['5bbdf94e-3aa2-4534-90aa-70a6c551ce98', '6fbd558a-4aa8-49b1-8f9a-9842dd55bfa0', '355dfbcb-a2d2-472d-89f6-194e63dc3072', '522a16a8-73bd-405e-959d-7e173e16b28a'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-536765d0-def5-475c-bc8a-7746e86a66d3 -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e" returned: 0 in 0.557s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:32 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e is being set with open permissions: ugo+rw Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:32 devstack sudo[91713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e Apr 22 09:30:32 devstack sudo[91713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:32 devstack sudo[91715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:32 devstack sudo[91715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:32 devstack sudo[91707]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b.5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548" returned: 0 in 0.571s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548" released by "_delete_snapshot" :: held 2.720s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b" released by "delete_snapshot" :: held 2.737s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created reservations ['b02cc7bc-abb8-4ccd-8edd-c8f6af1e32b1', '1d0f8382-92cc-4b39-8215-c0484dc4a066', 'b9ab5fdb-7ece-4e6b-9519-92aacf85bcec', '477c1bb1-282f-4f93-81b6-5089e5b497df'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:32 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Delete snapshot completed successfully. Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6a30a4a0-7866-439f-9ce5-d07182eb1768 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-5b8ae5c8-b6ce-46ce-b0e7-6dbea0d70548-delete_snapshot" released by "delete_snapshot" :: held 2.845s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:32 devstack sudo[91713]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e" returned: 0 in 0.467s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:32 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.info Apr 22 09:30:32 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:32 devstack sudo[91715]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.496s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:32 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Deleted volume successfully. Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-59194376-ac22-4d2c-88cc-4ce32f38ba42 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-b37ca264-7849-4794-ba76-0a8d9b1c14b7-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-530416da-b4fc-462d-8cd4-0e3d76bb5d77-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:32 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-530416da-b4fc-462d-8cd4-0e3d76bb5d77-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-quobyte-530416da-b4fc-462d-8cd4-0e3d76bb5d77" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-530416da-b4fc-462d-8cd4-0e3d76bb5d77" acquired by "delete_volume" :: waited 0.018s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7724434-7e7b-41f4-a5d2-b79083b586ac]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:33 devstack sudo[91728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 Apr 22 09:30:33 devstack sudo[91728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "cinder-quobyte-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0636787-b1d5-42d2-a8ed-9717cb370f73]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:33 devstack sudo[91730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b Apr 22 09:30:33 devstack sudo[91730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:33 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.info" returned: 0 in 0.502s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:33 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.info is being set with open permissions: ugo+rw Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:33 devstack sudo[91733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.info Apr 22 09:30:33 devstack sudo[91733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:33 devstack sudo[91728]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77" returned: 0 in 0.584s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:33 devstack sudo[91741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77 Apr 22 09:30:33 devstack sudo[91741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:33 devstack sudo[91730]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b" returned: 0 in 0.533s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:33 devstack sudo[91743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b Apr 22 09:30:33 devstack sudo[91743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:33 devstack sudo[91733]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.info" returned: 0 in 0.504s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:33 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.778s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:33 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-758b5601-f74f-4501-81e8-c9c0079de263 tempest-CinderUnicodeTest-1727626186 None] Create snapshot completed successfully Apr 22 09:30:34 devstack sudo[91741]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-530416da-b4fc-462d-8cd4-0e3d76bb5d77" returned: 0 in 0.465s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-530416da-b4fc-462d-8cd4-0e3d76bb5d77" released by "delete_volume" :: held 1.074s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Created reservations ['34daf304-4c2a-4248-bb3a-927f666d8b30', 'bf176754-d03b-4396-83f9-e65cd5c64b7e', 'e5f26589-2e25-4302-a487-1a1279757746', '7280a164-2f5d-4ee2-829e-d47f92c01211'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:34 devstack sudo[91743]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b" returned: 0 in 0.498s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:34 devstack sudo[91748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:34 devstack sudo[91748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-quobyte-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b" released by "delete_volume" :: held 1.063s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Created reservations ['be5ee746-b494-4da2-a456-289dbaaf3a41', '94aa9ec4-80d8-4f37-bad2-6e863dfaa80f', '2bb2f705-ffe4-4bb9-976d-3e8b9ad613d4', 'e2effb19-6d44-4878-9398-5f639962216c'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:34 devstack sudo[91750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:34 devstack sudo[91750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "cinder-14bd3641-a4a4-4603-bf8e-8b7b642ef08e-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-14bd3641-a4a4-4603-bf8e-8b7b642ef08e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "cinder-quobyte-536765d0-def5-475c-bc8a-7746e86a66d3" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-quobyte-536765d0-def5-475c-bc8a-7746e86a66d3" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "cinder-quobyte-14bd3641-a4a4-4603-bf8e-8b7b642ef08e" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-quobyte-14bd3641-a4a4-4603-bf8e-8b7b642ef08e" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Deleting offline snapshot 14bd3641-a4a4-4603-bf8e-8b7b642ef08e of volume 536765d0-def5-475c-bc8a-7746e86a66d3 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] snapshot_file for this snap is: volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[46feca67-00f8-42c8-a547-806d72deb033]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:34 devstack sudo[91748]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.525s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:34 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Deleted volume successfully. Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-114581be-e047-4a8b-a433-0b09f8b870d4 tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-530416da-b4fc-462d-8cd4-0e3d76bb5d77-delete_volume" released by "delete_volume" :: held 1.754s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:34 devstack sudo[91750]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.439s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:34 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e Apr 22 09:30:34 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:34 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Deleted volume successfully. Apr 22 09:30:34 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-8a72eec9-8888-40d5-9e2b-c88eb80b40e9 tempest-CreateVolumesFromSnapshotTest-1317927548 None] Lock "cinder-6ae0da4c-66c8-4ed6-96c6-c3c9cc887b2b-delete_volume" released by "delete_volume" :: held 1.675s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:35 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "cinder-quobyte-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e" returned: 0 in 0.564s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-536765d0-def5-475c-bc8a-7746e86a66d3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78417aa-59b0-4785-a458-134ce78248f2]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" acquired by "delete_volume" :: waited 0.040s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca70559-5763-4917-b53a-852ede36f897]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:35 devstack sudo[91759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 Apr 22 09:30:35 devstack sudo[91759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:35 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff Apr 22 09:30:35 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:35 devstack sudo[91759]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3" returned: 0 in 0.606s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:35 devstack sudo[91769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e Apr 22 09:30:35 devstack sudo[91769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:35 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" returned: 0 in 0.623s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:35 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:35 devstack sudo[91771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff Apr 22 09:30:35 devstack sudo[91771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:36 devstack sudo[91769]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e" returned: 0 in 0.581s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:36 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e Apr 22 09:30:36 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:36 devstack sudo[91771]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" returned: 0 in 0.579s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:36 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-quobyte-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff" released by "delete_volume" :: held 1.229s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:36 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Created reservations ['eb7fc978-0166-4f29-9c42-1065dcc4f79a', 'c97af603-bd00-46f0-b8ff-12c90b0de176', 'fdf8c284-0922-4765-8993-4ce57e1128b2', '4a8b84c7-5500-4d14-82e5-63a2f1e9f931'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:36 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:36 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:36 devstack sudo[91779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:36 devstack sudo[91779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:37 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3.14bd3641-a4a4-4603-bf8e-8b7b642ef08e" returned: 0 in 0.529s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-quobyte-14bd3641-a4a4-4603-bf8e-8b7b642ef08e" released by "_delete_snapshot" :: held 2.351s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-quobyte-536765d0-def5-475c-bc8a-7746e86a66d3" released by "delete_snapshot" :: held 2.362s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Created reservations ['e29aa537-65e8-4374-ab88-86df7f471d3a', 'c52c1d58-b95b-4844-ab7f-69ae5327880b', '94094edf-4617-4afd-b781-9376198ab8da', '7891ace3-4612-4982-9d05-66db9f057df6'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:37 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Delete snapshot completed successfully. Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-6e81f062-2043-47dd-8ad3-8ae7ec0c9781 tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-14bd3641-a4a4-4603-bf8e-8b7b642ef08e-delete_snapshot" released by "delete_snapshot" :: held 2.502s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:37 devstack sudo[91779]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.575s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:37 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Deleted volume successfully. Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-ce2e1f2e-10f5-4c32-96dd-ea7c3d978d1e tempest-VolumeDependencyTests-1225167530 None] Lock "cinder-93fdadef-7cf7-45e5-b28a-5ddb5eb0e2ff-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "cinder-536765d0-def5-475c-bc8a-7746e86a66d3-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-536765d0-def5-475c-bc8a-7746e86a66d3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "cinder-quobyte-536765d0-def5-475c-bc8a-7746e86a66d3" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-quobyte-536765d0-def5-475c-bc8a-7746e86a66d3" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00cfb76-a2bf-44ac-b8b9-bbe9e31bd4f5]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:37 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:37 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 Apr 22 09:30:37 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:38 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3" returned: 0 in 0.624s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:38 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:38 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3 Apr 22 09:30:38 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:39 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-536765d0-def5-475c-bc8a-7746e86a66d3" returned: 0 in 0.508s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-quobyte-536765d0-def5-475c-bc8a-7746e86a66d3" released by "delete_volume" :: held 1.176s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Created reservations ['afeb5507-87d9-4a85-a38f-d865f53037c2', '69ceabc4-2144-4b7f-a180-e63ece398f00', '64646196-280f-40e6-8b85-91b32e086548', 'f20333c2-3aed-4b2e-88bf-da293a8ca2dc'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:39 devstack sudo[91800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:39 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:39 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.455s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:39 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Deleted volume successfully. Apr 22 09:30:39 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-25744b2d-d31f-4b3e-9af3-cd0a352718c6 tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-536765d0-def5-475c-bc8a-7746e86a66d3-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "cinder-56b5059c-95f1-4602-aaad-a4e9146c7f7f-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-56b5059c-95f1-4602-aaad-a4e9146c7f7f-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "cinder-quobyte-56b5059c-95f1-4602-aaad-a4e9146c7f7f" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-quobyte-56b5059c-95f1-4602-aaad-a4e9146c7f7f" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[198ec5cf-059a-4ad6-b1c2-f12c697acf6b]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:40 devstack sudo[91828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f Apr 22 09:30:40 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:40 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f" returned: 0 in 0.544s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:30:40 devstack sudo[91833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f Apr 22 09:30:40 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Flow 'volume_create_manager' (cc0c62c2-8009-4edd-8f4b-18c89ad56935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056291ce-a10b-4d69-b31c-fcb645cdced0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (056291ce-a10b-4d69-b31c-fcb645cdced0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2133905629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c419ef25-d0cb-4fca-a300-bf83e590f94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='860fe0021f65402f84bc845a3a450f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:41Z,use_quota=True,user_id='449fc94dbb0249bc8d0e5d2b22eb595f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af5144c-2d87-4a22-9243-de0335ce2aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af5144c-2d87-4a22-9243-de0335ce2aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51544180-8a7b-4bc1-acb0-a283d089c8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51544180-8a7b-4bc1-acb0-a283d089c8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c419ef25-d0cb-4fca-a300-bf83e590f94c', 'volume_name': 'volume-c419ef25-d0cb-4fca-a300-bf83e590f94c', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5ddfa9-0347-4550-8ce1-dce64a199815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5ddfa9-0347-4550-8ce1-dce64a199815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f15a4a5-4ab7-4dfa-aa3a-6e02c3764312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:40 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Volume c419ef25-d0cb-4fca-a300-bf83e590f94c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c419ef25-d0cb-4fca-a300-bf83e590f94c', 'volume_size': 1} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2133905629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c419ef25-d0cb-4fca-a300-bf83e590f94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='860fe0021f65402f84bc845a3a450f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:41Z,use_quota=True,user_id='449fc94dbb0249bc8d0e5d2b22eb595f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)}" {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1500}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Creating volume c419ef25-d0cb-4fca-a300-bf83e590f94c {{(pid=82642) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:294}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:40 devstack cinder-volume[82642]: INFO cinder.volume.drivers.remotefs [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] casted to osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 Apr 22 09:30:40 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c 1073741824 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:40 devstack sudo[91835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c 1073741824 Apr 22 09:30:40 devstack sudo[91835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:41 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-56b5059c-95f1-4602-aaad-a4e9146c7f7f" returned: 0 in 0.399s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-quobyte-56b5059c-95f1-4602-aaad-a4e9146c7f7f" released by "delete_volume" :: held 0.974s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Created reservations ['5334343c-dce9-49d6-805d-38bf86e6980d', 'bdc4dca5-96c0-46a9-a8c2-b005a65f29ff', 'edf91dcc-5751-40f4-9b7c-c48bd1bf8d71', 'd3e82b44-419a-4105-9161-4a4f8261196a'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:41 devstack sudo[91841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:41 devstack sudo[91841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:41 devstack sudo[91835]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c 1073741824" returned: 0 in 0.520s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:41 devstack sudo[91844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c Apr 22 09:30:41 devstack sudo[91844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:41 devstack sudo[91841]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.489s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:41 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Deleted volume successfully. Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b3417989-8063-4e8e-83a2-da5241b7529b tempest-CinderUnicodeTest-1727626186 None] Lock "cinder-56b5059c-95f1-4602-aaad-a4e9146c7f7f-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:41 devstack sudo[91844]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c" returned: 0 in 0.500s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'} {{(pid=82642) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1526}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f15a4a5-4ab7-4dfa-aa3a-6e02c3764312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c419ef25-d0cb-4fca-a300-bf83e590f94c', 'volume_size': 1}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc7822c-1de7-4f4f-a5dd-14a48dc06565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:41 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Volume volume-c419ef25-d0cb-4fca-a300-bf83e590f94c (c419ef25-d0cb-4fca-a300-bf83e590f94c): created successfully Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbc7822c-1de7-4f4f-a5dd-14a48dc06565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:41 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Flow 'volume_create_manager' (cc0c62c2-8009-4edd-8f4b-18c89ad56935) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:41 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-099a19b4-8316-468b-afaa-412c5f7ee923 tempest-SnapshotDependencyTests-40310644 None] Created volume successfully. Apr 22 09:30:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:42 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] Creating offline snapshot c4bc446d-c0dc-484a-824a-739cdc966570 of volume c419ef25-d0cb-4fca-a300-bf83e590f94c {{(pid=82642) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1829}} Apr 22 09:30:42 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2331645c-6841-43cf-ade5-7637082fb265]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:42 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:42 devstack sudo[91848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c Apr 22 09:30:42 devstack sudo[91848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:43 devstack sudo[91848]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c" returned: 0 in 0.472s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 1G {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:43 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 1G Apr 22 09:30:43 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:43 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 1G" returned: 0 in 0.465s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:43 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c419ef25-d0cb-4fca-a300-bf83e590f94c -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:43 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c419ef25-d0cb-4fca-a300-bf83e590f94c -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 Apr 22 09:30:43 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:44 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c419ef25-d0cb-4fca-a300-bf83e590f94c -F qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570" returned: 0 in 0.429s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:44 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 is being set with open permissions: ugo+rw Apr 22 09:30:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:44 devstack sudo[91863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 Apr 22 09:30:44 devstack sudo[91863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:44 devstack sudo[91863]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570" returned: 0 in 0.404s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:44 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:44 devstack sudo[91866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.info Apr 22 09:30:44 devstack sudo[91866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:45 devstack sudo[91866]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.info" returned: 0 in 0.439s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:45 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.info is being set with open permissions: ugo+rw Apr 22 09:30:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.info {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:45 devstack sudo[91869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.info Apr 22 09:30:45 devstack sudo[91869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:45 devstack sudo[91869]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.info" returned: 0 in 0.394s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:45 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:45 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-e2c266da-7359-46bd-8f77-cdc792443c4c tempest-SnapshotDependencyTests-40310644 None] Create snapshot completed successfully Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.flows.manager.create_volume [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82642) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1398}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Flow 'volume_create_manager' (046ac889-2ba6-4a6c-a61a-6796d8cb408b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54bf19b5-ed7f-45a0-8a67-df228c2cd140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54bf19b5-ed7f-45a0-8a67-df228c2cd140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-22T07:30:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de2cea2f-2d89-4490-83c2-0b87a6c14cc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='860fe0021f65402f84bc845a3a450f88',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-22T07:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c4bc446d-c0dc-484a-824a-739cdc966570,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-22T07:30:46Z,use_quota=True,user_id='449fc94dbb0249bc8d0e5d2b22eb595f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c0b78d65-e430-4091-9d71-bd74abac8b7e),volume_type_id=c0b78d65-e430-4091-9d71-bd74abac8b7e)' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb526229-6028-4dcb-9e25-54feb5189b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb526229-6028-4dcb-9e25-54feb5189b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65bf8c9-9a77-449b-a027-0772d8626374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65bf8c9-9a77-449b-a027-0772d8626374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'de2cea2f-2d89-4490-83c2-0b87a6c14cc3', 'volume_name': 'volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3', 'volume_size': 1, 'snapshot_id': 'c4bc446d-c0dc-484a-824a-739cdc966570'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266abd51-0be9-43f3-ac20-767ddc87a047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266abd51-0be9-43f3-ac20-767ddc87a047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d7a4e1-21f2-4c82-9752-5bf6caef0c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:46 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Volume de2cea2f-2d89-4490-83c2-0b87a6c14cc3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3', 'volume_size': 1, 'snapshot_id': 'c4bc446d-c0dc-484a-824a-739cdc966570'} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "cinder-quobyte-c4bc446d-c0dc-484a-824a-739cdc966570-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" by "_create_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-c4bc446d-c0dc-484a-824a-739cdc966570-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Creating volume de2cea2f-2d89-4490-83c2-0b87a6c14cc3 from snapshot c4bc446d-c0dc-484a-824a-739cdc966570 {{(pid=82642) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Selected osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38 as target Quobyte volume. {{(pid=82642) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "cinder-quobyte-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" by "_copy_volume_from_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] snapshot: c4bc446d-c0dc-484a-824a-739cdc966570, volume: de2cea2f-2d89-4490-83c2-0b87a6c14cc3, {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7be7f7-9ce3-4492-ac29-1f8e2d488a83]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:46 devstack sudo[91872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 Apr 22 09:30:46 devstack sudo[91872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:46 devstack sudo[91872]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570" returned: 0 in 0.502s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c419ef25-d0cb-4fca-a300-bf83e590f94c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] will copy from snapshot at /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Creating direct copy from snapshot {{(pid=82642) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc51c94-8312-43d6-95f6-39f1f79e1651]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:46 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:47 devstack sudo[91878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c Apr 22 09:30:47 devstack sudo[91878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:47 devstack sudo[91878]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c" returned: 0 in 0.530s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:47 devstack cinder-volume[82642]: DEBUG cinder.utils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Path /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 not found in is_blk_device check {{(pid=82642) is_blk_device /opt/stack/cinder/cinder/utils.py:606}} Apr 22 09:30:47 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:47 devstack sudo[91883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 Apr 22 09:30:47 devstack sudo[91883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:49 devstack sudo[91883]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" returned: 0 in 1.908s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:49 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[74af93d9-6058-44a1-bfee-a665f2aa34f9]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:49 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:49 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c Apr 22 09:30:49 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:50 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c" returned: 0 in 0.592s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.image.image_utils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Image conversion details: src /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c, size 1024.00 MB, duration 1.91 sec, destination /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 {{(pid=82642) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:537}} Apr 22 09:30:50 devstack cinder-volume[82642]: INFO cinder.image.image_utils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Converted 1024.00 MB image at 536.31 MB/s Apr 22 09:30:50 devstack cinder-volume[82642]: WARNING cinder.volume.drivers.remotefs [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 is being set with open permissions: ugo+rw Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:50 devstack sudo[91902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 Apr 22 09:30:50 devstack sudo[91902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:50 devstack sudo[91902]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" returned: 0 in 0.409s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" released by "_copy_volume_from_snapshot" :: held 3.996s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-c4bc446d-c0dc-484a-824a-739cdc966570-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" released by "_create_volume_from_snapshot" :: held 4.013s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.022s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:UPDATE=297,cinder:SELECT=187,cinder:DELETE=25,cinder:INSERT=84 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=213,cinder:UPDATE=264,cinder:INSERT=49,cinder:DELETE=26 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d7a4e1-21f2-4c82-9752-5bf6caef0c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3', 'volume_size': 1, 'snapshot_id': 'c4bc446d-c0dc-484a-824a-739cdc966570'}' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4410fe-d848-4e42-9b1d-583b0439c5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 22 09:30:50 devstack cinder-volume[82642]: INFO cinder.volume.flows.manager.create_volume [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Volume volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 (de2cea2f-2d89-4490-83c2-0b87a6c14cc3): created successfully Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa4410fe-d848-4e42-9b1d-583b0439c5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82642) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Flow 'volume_create_manager' (046ac889-2ba6-4a6c-a61a-6796d8cb408b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82642) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 22 09:30:50 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-c71fe007-21ac-4400-9dcd-4330dae53d0a tempest-SnapshotDependencyTests-40310644 None] Created volume successfully. Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "cinder-c4bc446d-c0dc-484a-824a-739cdc966570-delete_snapshot" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-c4bc446d-c0dc-484a-824a-739cdc966570-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "cinder-quobyte-c419ef25-d0cb-4fca-a300-bf83e590f94c" by "delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-c419ef25-d0cb-4fca-a300-bf83e590f94c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "cinder-quobyte-c4bc446d-c0dc-484a-824a-739cdc966570" by "_delete_snapshot" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-c4bc446d-c0dc-484a-824a-739cdc966570" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Deleting offline snapshot c4bc446d-c0dc-484a-824a-739cdc966570 of volume c419ef25-d0cb-4fca-a300-bf83e590f94c {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1301}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] snapshot_file for this snap is: volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 {{(pid=82642) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1330}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba447f5-236f-40b8-83e6-532984590de8]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:50 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:50 devstack sudo[91905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 Apr 22 09:30:50 devstack sudo[91905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:51 devstack sudo[91905]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570" returned: 0 in 0.479s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:51 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.remotefs [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c419ef25-d0cb-4fca-a300-bf83e590f94c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82642) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:905}} Apr 22 09:30:51 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[950b0eed-b021-42b7-b5ed-27aece757780]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:51 devstack sudo[91911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c Apr 22 09:30:51 devstack sudo[91911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:51 devstack sudo[91911]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c" returned: 0 in 0.482s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:51 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:51 devstack sudo[91916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 Apr 22 09:30:51 devstack sudo[91916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:52 devstack sudo[91916]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570" returned: 0 in 0.447s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:52 devstack sudo[91921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570 Apr 22 09:30:52 devstack sudo[91921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:52 devstack sudo[91921]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c.c4bc446d-c0dc-484a-824a-739cdc966570" returned: 0 in 0.389s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-c4bc446d-c0dc-484a-824a-739cdc966570" released by "_delete_snapshot" :: held 1.847s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-c419ef25-d0cb-4fca-a300-bf83e590f94c" released by "delete_snapshot" :: held 1.859s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Created reservations ['d3770a26-3cb8-4140-a122-59b76e2167ad', 'd1afbc2f-0540-4c32-bf32-ce306dfce862', '6fb70fc7-e672-4100-989d-2f5a0307b81d', 'e986fb8d-1d99-4285-90ea-b114bd14dd46'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:52 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Delete snapshot completed successfully. Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-b6776866-aa32-45b8-9dde-4b441d654fc2 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-c4bc446d-c0dc-484a-824a-739cdc966570-delete_snapshot" released by "delete_snapshot" :: held 1.945s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "cinder-c419ef25-d0cb-4fca-a300-bf83e590f94c-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-c419ef25-d0cb-4fca-a300-bf83e590f94c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "cinder-quobyte-c419ef25-d0cb-4fca-a300-bf83e590f94c" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-c419ef25-d0cb-4fca-a300-bf83e590f94c" acquired by "delete_volume" :: waited 0.008s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba3e6b3-9143-449a-8ffe-867d9a9bb47d]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:52 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:52 devstack sudo[91924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c Apr 22 09:30:52 devstack sudo[91924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:53 devstack sudo[91924]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c" returned: 0 in 0.474s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:53 devstack sudo[91929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c Apr 22 09:30:53 devstack sudo[91929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:53 devstack sudo[91929]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-c419ef25-d0cb-4fca-a300-bf83e590f94c" returned: 0 in 0.410s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-c419ef25-d0cb-4fca-a300-bf83e590f94c" released by "delete_volume" :: held 0.918s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Created reservations ['bb92a627-e3e8-42aa-9a67-727c6f0642cb', 'b274774f-3234-4b7c-a72f-e9002c41a2d0', 'e70ec9d7-ddf6-4091-ba2c-92054fcd6d5d', 'ce83e52e-a218-48f8-aa5b-b20df3d15eba'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:53 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:53 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "cinder-de2cea2f-2d89-4490-83c2-0b87a6c14cc3-delete_volume" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-de2cea2f-2d89-4490-83c2-0b87a6c14cc3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "cinder-quobyte-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" by "delete_volume" {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" acquired by "delete_volume" :: waited 0.007s {{(pid=82642) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cba219f-d740-4e90-a70d-e0ecddcd9a06]: (4, 'qcow2') {{(pid=83674) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 22 09:30:53 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:54 devstack sudo[91934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 Apr 22 09:30:54 devstack sudo[91934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:54 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.423s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:54 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Deleted volume successfully. Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-f0bd8628-60ae-4d0b-aa39-be3198297972 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-c419ef25-d0cb-4fca-a300-bf83e590f94c-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:54 devstack sudo[91934]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" returned: 0 in 0.459s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:54 devstack sudo[91940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3 Apr 22 09:30:54 devstack sudo[91940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:54 devstack sudo[91940]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0/volume-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" returned: 0 in 0.400s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-quobyte-de2cea2f-2d89-4490-83c2-0b87a6c14cc3" released by "delete_volume" :: held 0.881s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG cinder.quota [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Created reservations ['cf173b93-b217-417e-b028-a00c98136727', '1f241e26-062e-46ae-9f7c-af3775276da0', 'f75ab069-0d95-4055-9b7d-c9f4ae3e6e70', '6a010935-6e86-4266-a378-f06adbfe3145'] {{(pid=82642) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38': None} {{(pid=82642) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG cinder.volume.drivers.quobyte [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-05f624c5-d74b-43be-b86f-8b782742df38'] {{(pid=82642) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.lockutils [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82642) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 22 09:30:54 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 22 09:30:54 devstack sudo[91943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0 Apr 22 09:30:54 devstack sudo[91943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 22 09:30:55 devstack sudo[91943]: pam_unix(sudo:session): session closed for user root Apr 22 09:30:55 devstack cinder-volume[82642]: DEBUG oslo_concurrency.processutils [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/0deda60ebee5b54ff63ebd5d69b6a0e0" returned: 0 in 0.427s {{(pid=82642) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 22 09:30:55 devstack cinder-volume[82642]: DEBUG cinder.manager [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Notifying Schedulers of capabilities ... {{(pid=82642) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 22 09:30:55 devstack cinder-volume[82642]: INFO cinder.volume.manager [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Deleted volume successfully. Apr 22 09:30:55 devstack cinder-volume[82642]: DEBUG cinder.coordination [None req-72e35760-ebae-479c-8a48-fa3b2a510da7 tempest-SnapshotDependencyTests-40310644 None] Lock "cinder-de2cea2f-2d89-4490-83c2-0b87a6c14cc3-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=82642) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 22 09:31:04 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:SELECT=14,cinder:INSERT=6,cinder:UPDATE=24 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 22 09:31:05 devstack cinder-volume[82642]: DEBUG dbcounter [-] [82642] Writing DB stats cinder:UPDATE=21,cinder:DELETE=3,cinder:SELECT=17,cinder:INSERT=6 {{(pid=82642) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}